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ABSTRACT 

This paper reports the results from one of a series 
of related, collaborative studies carried out in Sandy Bay, Tasmania, 
Australia, in 1979 and 1980, examining how young children acquire the 
skills to represent and solve addition and subtraction problems. The 
purpose of this study was to relate children's cognitive processing 
capabilities and their grade level to performance on addition and 
subtraction test items. Two sets of data were used to assess memory 
capacity and cognitive processing capacities. Six groups of children 
were then identified with different specific cognitive 
characteristics. A sample of children in five classes at Grades 1, 2, 
and 3 was selected and a set of addition and subtraction problems was 
administered on three occasions. Items were scored correct or 
incorrect, and data were summarized for each administration by grade 
and cognitiva level. Differences were found for specific objectives, 
for instruction over time, and for grade level. Importantly, children 
who differed in cognitive processing capacity consistently performed 
differently regardless of other salient factors. (Author/JM) 
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Abstract 



This paper reports the results of the fourth of a series of 
collaborative studies examining how young children acquire the skills 
to represent and solve addition and subtraction problems. The pur- 
pose of this study was to relate children's cognitive processing 
capabilities and their grade level to their performance on a basic 
set of addition and subtraction test items. 

From two sets of data which assessed memory capacity and cogni- 
tive processing capacities, we identified six groups of children with 
different specific cognitive characteristics. A sample of children in 
five classes at Grades 1, 2, and 3 was selected and administered a set 
of addition and subtraction problems on three occasions. The items 
were scored correct or incorrect, and data were summarized for each 
administration by grade and cognitive level. 

There were important variations due to specific objectives, to 
instruction over time, and to grade. However, what is clear is that 
children who differ in cognitive processing capacity consistently 
performed differently regardless of the other in^portant factors. 
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This paper reports the results from one of a series of related, 
collaborative studies carried out in Sandy Bay, Tasmania, Australia, 
in 19 79 and 1980, In those studies, we examined how young children 
acquire the skills to represent and solve a variety of verbal addition 
and subtraction problems. We assumed that the evolution of children's 
performance on addition and subtraction tasks must be related both to 
their cognitive abilities and to their engagement in related instruc- 
tional activities. The purpose of the study reported in this paper 
was to relate the children's cognitive capacity and their grade level 
to their performance on a standard set of items related to addition 
and subtraction. 

The Collaborative Studies 

This series of studies was jointly funded by the Research Committee 
of the Graduate School at the University of Wisconsin, the University 
of Wisconsin Center for Education Research, and the University of 
Tasmania. The principal investigators of the studies brought different 
backgrounds and skills to this collaborative effort. The identifica- 
tion of cognitive abilities grows out of Professor Collis' extensive 
work in cognitive development (for example, see Collis & Biggs, 1979). 
The classroom engagement ideas stem from Professor Romberg's research 
on teaching (see Romberg, Small, & Carnahan, 1979). 

The strategy adopted for the sequence of collaborative studies 
has five steps: 
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1. Identify "M-space" for a population of children of ages 4-b. 

2. Identify "cognitive processing capabilities" for the same 
set of children. 

3. From (1) and (2) identify sets of children with different 
specific cognitive characteristics. 

4. From (3) identify a sample of children and observe their en- 
gagement in instructional activities on related tasks for three 
months . 

5. Measure, on three occasions over the three-month period, the 
sample children's performance and note the strategies they use with 
addition and subtraction problems. 

This procedure was designed to allctw u3 to relate performance at 
a given time (in terms of level achieved and strategy adopted) to the 
child's cognitive capability and to the specific set of instructional 
activities the child has been engaged with. In this way, we can con- 
sider various questions about change in performance and strategy and 
their possible causes. 

This Study 

The importance of knowing how 'hildren learn the procedures of 
addition and subtraction shoula be self-evident. Also, it is fre- 
quently assumed that children must first master those computational 
skills and then begin to solve addition and subtraction problems. 
However it has been clearly demonstrated that children develop a 
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variety of strategies for solving mathematical problems independent of 
Instruction (c.f., Ginsburg, 1977; Resnick, 1978; Carpenter & Moser, 
1979). In fact, many of the strategies they use are more sophisticated 
and demonstrate more insight than the procedures that are taught. This 
finding raises questions about the relationships of children's instruc- 
tional experience and their capacity to their performance and their 
selection of strategies. 

A sample of children from two schools in Sandy Bay who had been 
examined in the previous studies in this series (Romberg & Collis, 
1980a; 1980b; Romberg, Collis, & Buchanan, 1981) were administered a 
set o£ items on three occasion;, over a three- to four-month period in 
1980 (February 29, April 11, and May 28 or July 6). In each administra- 
tion a set of test items was given to each student. Each child's per- 
formance on all items was marked. This report presents the data from 
those test administrations. 

Cognitive Capacity 

To identify children witn differing cognitive capacities, a three- 
step procedure was followed. First, we identified memory capacity (M-- 
space) for a population of children of ages 4-8 (Romberg & Collis, 1980a), 
Four M-space tests were administered. 

Second, we identified cognitive processing capabilities for the 
same set of children (Romberg & Collis, 1980b). Fifteen different tests 
were given. From a factor analysis of those scores, a quantitative 
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factor, a qualitative correspondence factor, and a logical reasoning 
factor were identifie 

Third, from both sets of data, we identified six groups of children 
with different specific cognitive characteristics. A cluster analysis 
procedure was used to group the children. 

Cognitive Level 1 children operate at M-space Level 1, are capable 
of handling qualitative comparisons and transformations at a moderate 
level, and are incapable of dealing with quantitative tasks or logical 
reasoning. Cognitive Level 2 children operate at M-space Level 2, 
handle qualitative correspondence tasks, and cannot handle quantitative 
and logical skills (but were considerably better than Group 1 on all 
tasks). Cognitive Level 3 children also operate at M-space Level 2, are 
high on qualitative correspondence, have developed the specific skills 
of counting on and counting back, are inadequate in their use of those 
counting skills on transitive reasoning, and are inadequate on logical 
reasoning. Cognitive Level 4 children operate at M-space Level 3, are 
high on qualitative correspondence and all the quantitative tests, but 
are inadequate on the logical reasoning test. Cognitive Levels 5 and 6 
are at M-space Levels 3 and 4* They reach the ceiling on the qualita- 
tive correspondence tests, have very high scores on all the quantita- 
tive tests, and also are high on logical reasoning. 

Because these latter two groups were both small, included only 
third graders, and only differed in memory capacity, these groups have 
been combined for this analysis. We began with rosters of students 
from fe. ch grade and their cognitive level. Then an initial selection 
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of students was made. The student? by cognitive level and grade in this 
study are shown in Tablt 1. 

Description of the Tests 

A battery of paper-and- pencil tests had previously been developed 
to monitor student achievement on addition and subtraction skills at 
Grades 1, 2, and 3 (Buchanan & Romberg, 1982). The battery contained 
three test forms for each grade. The items were written to assess the 
insuructional objectives of ten experimental topics designed to teach 
addition and subtraction as well as to measure performance on certain 
prerequisite objectives and nonins tructional objectives (Romberg, 
Carpenter, & Moser, 1978). A summary of all objectives included in 
the baLtery is provided in Table 2. Not all objectives were assessed 
at all grade levels, however; the assignment of objectives to test fonr 
(grade) is outlined below. For this study, because of the small sample 
of students to be tested, one of the three forms was administered at 
each grade (Form K at Grade 1, Form S at Grade 2, Form V at Grade 3). 
Copies of the tests and administrator's manuals appear in Appendix A. 

Form K was a 30-minute test containing three subtests: a ''.S-item 
multiple-choice subtest and two separate 9-item subtests assessing re- 
call of addition and subtraction facts under speeded conditions. 
Form S was a 35-minute test containing four subtests; three of the sub- 
t Its were similar to the Form K subtests with some items dropped and 
some added forming a 19 -item multiple-choice subtest and two 12-item 
recall tests. The fourth subtest was a 4-item free response sentence- 
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Table 1 

Children at Each Cognitive Level 
in Each Grade 



Sandy Bay Waimea Heights 



Cognitive 
Level 


Infant 


School 


Primary School 


Total 


Grade 1 


Grade 2 


Grade 3 




1 


3 


2 


0 


5 


2 


3 


5 


4 


13 


3 


1 


2 


7 


10 


4 


0 


0 


6 


8 


5,6 


0 


0 


6 


6 


Total 


7 


9 


23 
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Table 2 

Objectives Asse ssed In Addition find Subtrflctlon 
Achievement Monitoring Battery 



Prerequisite Instructional Objectives 



Non-lnstructlonal Objectives 



Numerous ness 
0-10 
11-20 

0-99, writes 
0-99, represents 

Ordering, Place Value 

sets, one-to-one correspondence 
numbers 0-20 
numbers 0-99, orders 
numbers 0-99, notation 

Instructional Objectives for the S and 
A Topic Series 

Open Sentences 
add 0-20 
subt 0-20 

Sentence-Writing 0-20 
add-slmple joining 
subt-slmple separating 
subt-part part whole-addend 
add-part part whole 
subt-comparlson 
sub t- j oln-addend 

Sentence-Writing 0-99 
add-slmple Joining 
subt-slmple separating 
subt-part part whole-addend 
add-part part whole 
subt-comparlson 
sub t-j oln-addend 

Algorithms 
add 0-99 
subt 0-99 



Problem-Solving 0-20 
add-siii5)le joining 
subt-slmple separating 
subt-part part whole-addend 
add-part part whole 
subt-comparlson 
s ub t- j o in- add end 

Problem- Solving 0-99 
add-stmple joining 
subt-slmple separating 
subt-part part whole-addend 
add-part part whole 
sub t- c omp ar Is on 
s ub t - j o In- add end 

Counting 9-31 
on 

back 

Basic Facts — Speeded Test 
add 0-20 
subt 0-20 

Algorithms — Timed Test 
add 0-99 
subt 0-99 
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writing measure. Form V for third grade was a 40-minute test containing 
six subtests. In this case the two recall subtests and the sentence- 
writing subtest were identical to the Form S subtests. Five items 
were dropped from the Form S multiple-choice subtest leaving 14 items. 
The two new subtests were 24-item timed measures of performance on 
addition and subtraction algorithms. 

Multiple-choice subtests . An outline of the content of the 
multiple-choice subtest for each grade is given In Table 3. Individual 
objectives in the areas of numerousness, ordering, place value, open 
sentences, and algorithms were represented by one multiple-choice item 
in each test form on which they were assessed. (Not all objectives 
were assessed at all grades.) For the two objectives for counting, 
c mting on and counting back for numbers to 18, there was one item 
per form; however, an additional counting item for numbers to 31 was 
included in each test because information on these numbers was of 
potential interest relative to interview problem situations using 
larger items. 

Four individual objectives for sentence-writing were represented 
by a multiple-choice item in each form. For Grade 1 these items con- 
tained numbers 5-9 or 11-15; for Grades 2 and 3 the number domains 
were 11-15 and 0-99. Since there was no way in a multiple-choice 
format to have students actually write a sentence, the items required 
listening to a verbal problem read aloud and then choosing the sentence 
which correctly represented the verbal situation. The problem situa- 
tion itself was not printed on the test page. This prevented reading 



Table 3 

Item Content of Multiple-Choice Subtests 



Item J 
Label 



Form K (Grade 1) 



Form S (Grade 2) 



Form V (Grade 3) 



H 
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Numerousness 
0-10 

Numerousness 
11-20 

Opftn Sentences 
ada 0-10 

Open Sentences 
subt 11-18 

Problem-Solving 0-20 

subt-comparison 11-15 

Problem-Solving 0-20 
add-part part whole 5-9 

Ordering 

sets, one-to-one correspondence 

Ordering 
numbers 0-20 

Sen tence-Wr ting 0-20 
subt-comparison 5-9 

Sentence-Writing 0-20 
subt-simple separating 11-15 

Sentence-Writing 0-20 
add-simple joining 11-15 



Numerousness 
writes 0-99 

Numerousness 
represents 0-99 

Open Sentences 
add 0-10 

Open Sentences 
subt 11-18 

Problem-Solving 0-20 
subt-comparison 11-15 

Problem-Solving 0-99 
add-part part whole 0-99 

Ordering, Place Value 
ordering 0-99 

Ordering, Place Value 
place value 0-99 

Sentence Writixig 0-20 
subt-simple separating 11-15 

Sentence-Writing 0-99 
subt-comparison 0-99 

Sentence-Writing 0-20 
subt -part part whole-addend 
11-15 



Numerousness 
writes 0-99 

Numerousness 
represents 0-99 

Problem-Solving 0-20 
subt-comparison 11-15 

Problem-Solving 0-99 
add-part part whole 0-99 

Problem-Solving 0-20 

subt-part part whole-addend 11-15 

Problem-Solving U-99 
subt -join -addend 0-99 

Ordering, Place Value 
ordering 0-99 

Ordering, Place Value 
place value 0-99 

Sentence Writing 0-20 
subt-simple separating 11-15 

Sentence- ^/titing 0-99 
subt-comparison 0-99 

Sentence-Writing 0-20 

subt-part part whole-addend 11-15 
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Sentence-Writing 0-20 
subt-part part whole-addend 
11-15 

Count ing 
on 9-18 



Sentences-Writing 0-99 
add -simple joining 0-99 



Problem-Solving 0-20 
subt-part part whole-addend 
11-15 



Sentence-Writing 0-99 
add-simple joining 0-9? 



Algorithms 
add 0-99 



Counting 
back 9-18 



Problem-Solving 0-99 
subt-join-addend 0-99 



Algorithms 
subt 0-99 



Count ing 
on 18-31 



Algorithms 
add 0-99 




Algorithms 
subt 0-99 

Counting 
on 9-18 

Counting 
back 9-18 



U 



Counting 
on 18-31 



Items A and 6 are samples. 
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difficulties and also was in keeping with the procedures for the inter- 
views in whicL the problems were presented orally. 

For Form K two objectives for the problem-solving area were assessed 
while for Forms S and V four objectives were included. The number 
domains were the same as for the sentence-writing objectives and, again, 
the problem situations were not printed in the student booklets. 

All of the questions in the multiple-choice section of the tests 
were read to the children and then the key phrases were repeated; in 
the case of the verbal problems for the sentence^riting and problem- 
solving objectives, the entire story situation was read twice. The 
children then marked an X on one of the four response choices: the 
solution, two dis tractors, and the "puzzled face," an option which 
indicated "I have not learned this yet." The response choices, symbols, 
and pictures were not read or explained to the children (with the excep- 
tion of the "puzzled face") . 

The "puzzled face" option was provided to avoid unnecessary frus- 
tration and to reduce the amount of random guessing. Although it was 
expected that the "puzzled face" choice would be used throughout the 
achievement testing because there would always be objectives not yet 
introduced and/or mastered, this option was particularly useful at the 
baseline period. Marking thfi "puzzled face" allowed children to give 
a positive response indicating that they hadn^t yet learned to find the 
answer to the question. 

Speeded subtests. There were 9 addition and 9 subtraction facts 
on Form K and 12 on each of Forms S and V. The first six problems in 
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each case covered the facts from 4 to 9; the last three (or six) Involved 

10 to 18 (see Table 4) . The addition and subtraction recall subtests 

were introduced by the test administrator; then specific directions on 

a tape recording preceded the items presented with intervals of 4 seconds' 

vorking time for Form K and 2 seconds' for Form S and V. The children 

wrote their answers in designated spaces, leaving spaces for unknown ^ 

facts empty. There was a short break between the two subtests. 

Sentence-writing free response subtests . Four of the 12 individual 
sentence-writing objectives (verbal problem types) for the numbers 0-20 
and 0-99 were assessed in Forms S and V. A free response format was 
employed in which a verbal problem was read twice to the students who 
were directed to write a sentence for the situation and not solve the 
sentence. There were two 0-20 and two 0-99 items per test. Table 5 
provides an outline of the subtest items. 

Addition and subtraction algorithms timed subtests . These subtests, 
in Form V only, each contained 24 items. The items were either 2-digit 
or 3-digit; 18 items required regrouping, 6 did not. The items were 
arranged in order of difficulty (see Table 6). For example, 3-digit 
problems not requiring regrouping preceded 3-digit problems which re- 
quired regrouping and, for 3-digit regrouping problems, those in which 
only the ones were regrouped preceded those in which both ones and tens • 
were regrouped. The students were instructed to try each problem in 
order (the problems were alphabetized) and to go on to the next problem 
if unable to do a particular example. Six minutes was allowed for each 
subtest. 
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Table A 

Addition and Subtraction Facts Recall Items- 
Speeded Subtests, Forms K, S, and V 
(Grades 1, 2, and 3) 



Addition Facts Recall Subtests Subtraction Facts Recall Subtests 



3+1 


7 




1 

X 


2 + 5 


8 




4 


1 + 6 


9 




5 


7 + 2 


7 




4 


2 + 6 


8 




6 


3+5 


4 




3 


4+8 


11 




2 


3+7 


13 




8 


5+9 


12 




7 


6 + 8 ^ 


15 




9 ^ 


8 + 7 


10 




2 


4+9 


16 




7 



The last three items in each subtest do not appear in Form K. 
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Table 5 

Item Content of Sentence-Writing Free Response 
Subtest Forms S and V 
(Grades 2 and 3) 

Item 

Label Content 



Sentence-Writing 0-20 
add-part part whole 11-15 
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Sentence-Writing 0-99 
subt-simple separating 0-99 



Sentence-Writing 0-99 

subt-part part whole-addend 0-99 



Sentence-Writing 0-20 
sub t- Join-addend 11-15 
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Table 6 

Item Content of Addition and Subtraction 
Algorithms — ^Timed Subtests Form V 
(Grade 3) 



TvDP nf PtoM OTn 


Nuniber of Items 


Addition Subtest 




2-dlglt without regrouping 


3 


3-diglt without regrouping 


3 


2-dlglt with regrouping 


.a 

0 


3-diglt with regrouping 


9 


2-dlglt with regrouping, 3 addends 


3 


Subtractlor Subtest 




2-dlglt without regrouping 


3 


3-dlglt without regrouping 


3 


2-dlglt with regrouping 


6^ 


3-dlglt with regrouping 


12 



Three of the 6 items are 2-digit + 1-digit. 
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Test Administratio n 

Guidelines for administering the achievement tests were provided 
to each of the three assistants (see Appendix B) . The guidelines in- 
dicated which tests were to be given, dates for administration, and so 
forth. 

The first administration was supervised by Professor Romberg and 
went smoothly. The second and third administrations were carried out 
after Professor Romberg had returned to the U.i;. These test administra- 
tions at Grade 1 went smoothly as scheduled. At Grade 2 one item on 
Form S did not copy well so students could not read that question. At 
Grade 3 there were two administrative mixups. First, Form S rather 
than Form V was given in April to all three classes and in May to two 
of the classes. This is not a serious problem since many items are the 
same, except that the timed algorithms tests were not given. Second, 
in Che third class Form V was given in July rather than May. The May 
administration was scheduled for near the end of the autumn term, but 
the assistant failed to administer the tests at that time. After a 
short break, children returned to school to start the winter term. 
The assistant asked whether she should still gather the data and was 
advised to administer Form V in July. The results of this administra- 
tion would not reflect a lot of additional instruction since there was 
a break between terms. All data were then shipped to Madison and scored 
by Center staff. A record of each subject *s response to the items was 
compiled from the test forms. These profiles are the basis for all 
summary information appearing in this paper. 
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Da ta Aggregation and Analysis 

The data gathered In th^s study have been summarized In terms of 
percent correct with respect to grades and cognitive level. 

Grade. The percent correct for students at Grade 1 on the Items 
(I.e., Individual objectives) and composite objectives for each of 
the three administrations ±a shewn In Table 7. Overall, the data show 
that this sample of students at the start of the school year (February) 
had acquired the prerequisite objectives and could solve the verbal 
addition problems (but probably not by addition), and some (A3Z) could 
find the answer to an open addition problem. They coulJ not solve sub- 
traction problems, write sentences, count on or count back, nor could 
they recall basic facts. 

By the end of the autumn term (May) , addition skills of these stu- 
dents had Improved dramatically. Percent correct Improved for solving 
an open sentence, 43Z to 86X; writing a correct addition sentence, 29Z 
to 57%; counting on, 29% to 57Z; and addition facts, 33% to 76%. How- 
ever, the same cannot be said for subtraction. Only for solving a verbal 
comparison problem (29% to 71%) and for subtraction facts (29% to 56%) 
was marked Improvement. 

For Grade 2 the picture Is somewhat different (see Table 8). Over- 
all for this sample of nine students, at the beginning of the school 
year the percent correct was quite low. In fact, on only three Items 
did more that half of the students get the con. ct answer. Part of the 
difficulty was that Form S used large numbers (0-99) In several of the 
questions. By May Improvement on several composite objectives was 
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Table 7 

Percent Correct for Objectives and Composite Objectives by 
Administration Time for Grade 1, Form K 



ERIC 



Description of Objectives 




Results for Objectives 




Results 


for Composite Objectives 


NuT'b 
of I'. 


er 
ens 


Feb. 


April 
N=7 


May 
N=7 


Number 
of Items 


Feb. 
N=7 


April May 
N=7 N=7 


Prerequisite Instructional Objectives 


















Numerousness 
0-10 
11-20 


1 
1 




100 
71 


100 
43 


100 
86 


2 


86 


71 93 


Ordering 

sets, one-to-one correspondence 
numbers 0-20 


1 
1 




86 
100 


71 
100 


86 
86 


2 


93 


86 86 


Instructional Objectives for S Topics 


















Open Sentences 
add 0-20 
subt 0-20 


1 
1 




A3 
14 


57 
14 


86 
14 


2 


29 


36 50 


Sentence-Writing 0-20 

subt-slmple separating (11-15) 
subt-comparison (5-9) 
add-8lmple Joining (11-15) 
subt-part part whole-addend (11-15) 


1 
1 
1 
1 




14 

9Q 

29 
14 


0 

1 L 

14 
14 


0 
0 

57 
29 


4 


21 


11 21 


Noninstructional Objectives 


















Problem Solving 0-20 

add-part part whole (5-9) 
subt-coiiq>arlson (11-15) 


1 
1 




100 
29 


100 
14 


100 
71 


2 


64 


57 86 


Counting On 9-31 


2 




29 


43 


57 








Counting Back 9-31 


1 




0 


14 


14 


3 


19 


33 43 


Recall of Basic Facts — Speeded Test 
add 0-20 
subt 0-20 












9 
9 


33 
29 


49 76 
44 56 



00 



Table 8 

Percent Correct for Objectives and Composite Objectives by 
Administration Time for Grade 2, Form S 



Results for Objectives Results for Composite Objectives 

Description of Objectives — — - ■ ■ — 

Number Feb. April May Number Feb. April May 

of Items N=9 N»9 N==8 of Items N=9 N=9 N=8 



Prerequlaite Instructional Objectives 
Numerousness 



writes 0-99 


^ 


— 


— 










represents 0-99 


1 


56 


67 


75 


1 


56 


67 


Orderins. Place 
















orderine 0— QQ 






n 


Lj 








nlace value n«-QQ 


1 


n 


n 


1 

1 J 


O 

L 


o 


n 
u 


Ins true tion«d Objectives for S and A Topics 
















On^n ^ofi 1*011 ceo 
















add 0-20 


T 

X 




7ft 
/o 










subt 0-20 


1 


11 


0 


75 


2 


17 


39 


Sentence-Writing 0-20, 0-99 
















(multiple choice) 
















subt-slmple separating (11-15) 


1 


33 


33 


25 








subt-comparison (0-99) 


1 


0 


0 


0 








add-simple joining (0-99) 


1 


11 


11 


25 








subt-part part whole-addend (11-15) 


J. 


22 


11 


13 


4 


17 


14 


Sentence-Writing 0-20, 0-99 
















(free response) 
















subt-<ilmple separating (0-99) 


1 


56 


44 


75 








subt-part part whole-^addend (0-99) 


1 


0 


0 


0 








add-part part whole (11-15) 


1 


56 


89 


100 








subt- join-addend (11-15) 


1 


0 


78 


63 


4 


28 


53 


Algorithms 
















addition algorithm 


1 


11 


33 


13 








subtraction algorithm 


1^ 


11 


0 


38 


2 


11 


17 



75 



19 



88 



16 



59 



25 
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Table 8 (continued) 



o 





Results for Objectives 




Results for 


Composite Objectives 


Description of Objectives 


Number 


Feb. 


April 


May 


Number 


Feb. 


April 


May 




of items 


N=9 


N=9 


N=8 


of Items 


N=9 


N=9 


N-8 


Nonlnstructlonal Objectives 


















rroDxeiDr-ooxvxng u— u^yy 


















add-part part whole (0-99) 


1 


u 


99 


25 










subt-comparlson (11-15) 


1 


22 


56 


50 










subt^Dart D£irt vhnlp^AddpnH IS) 


1 




67 


13 










subt-joln-addend (0-99) 


1 


22 


11 


13 


A 


22 


39 


25 


Cotinting On 9-31 


2 


33 


28 


81 










Counting Back 9-31 


1 


22 


kk 


25 


3 


30 


33 


63 


Recall of Basic Facts — Speeded Test 


















add 0-20 










12 


29 


35 


51 


subt r-20 










12 


23 


30 


53 



Students were ui able to complete Item because tests duplicated pcorly. 
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apparent. The students were comfortable with numerousness of larger 
sets (56% to 75%), had Improved on basic facts (29% to 51% and 23% to 
53%, but not yet to any level of mastery), could solve simple open 
sentences (17% to 88%) , and had improved in counting (30% to 63%) and 
writing sentences for verbal problems (28% to 59%). But increases in 



performance were not apparent for ordering large numbers, problem 
solving, selecting written sentences for verbal problems, and algorithms. 

For the Grade 3 students, the picture was more encouraging (see 
Table 9). In February, their performance was not high (above 80%) ex- 
cept on two items, but by the end of May (or early July) performance 
on all composite objectives except one was approaching or about 80%. 
The one exception was the item on place value for numbers 0-99. Sen- 
tence writing-selecting skills had improved, but for some subtraction 
situations (comparison and part-part-whole addend) scores were not 
yet high. 

Performance of the Grade 3 students on the timed algorithms test 
is shown in Table 10. In February when all 22 children were tested, 
they performed well on the six addition-^ithout-regrouping problems and 
fair on the three items testing 2-digit subtraction without regrouping. 
On all others, they did poorly. Part of the difficulty was that because 
of the timed conditions most did not attempt the last items in the test. 
Those children who did reach the items did fairly well on the addition 
regrouping items but had considerable difficulty with the subtraction 
items requiring regrouping. 
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Table 9 

Percent Correct for Objectives and Composite Objectives by 
Administration Time for Grade 3, Forms S, V 



to 



Results for Objectives Results for Composite Objectives 

Description of Objectives — 

Number Feb. April May/July^ Number Feb. April May/July 

of Items N=22 N=22 N=ll/12 of Items N=22 N=22 N=ll/12 



Prerequisite Instructional Objectives 



Numerous ness 

writes 0-99 1 
represents 0-99 1 

Ordering, Place Value 

ordering 0-99 1 
place value 0-99 1 

Instructional Objectives for S and A Topics 

Sentence-Writing 0-20, 0-99 

(multiple choice) 

subt-simple separating (11-15) 1 

8ubt-coiq)arlson (0-99) 1 

add-slmple joining (0-99) 1 

subt-part part whole-addend (11-15) 1 

Sentence-Writing 0-20, 0-99 

(free response) 

subt-simple separating (0-99) 1 

subt-part part whole-addend (0-99) 1 

add-part part whole (11-15) 1 

subt-joln-addend (11-15) 1 



/. c 
HJ 


00 












91 


91 


100/91 


2 


68 


61 


82/92 


36 


91 


64/75 










23 


50 


0/42 


2 


30 


70 


32/58 


60 


91 


73/100 










x8 


14 


18/58 










77 


91 


64/100 










10 


50 


9/75 


4 


41 


61 


41/83 


36 


77 


82 '92 










5 


23 


18/67 










68 


95 


100/92 










45 


60 


55/75 


4 


39 


64 


64/81 
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Table 9 (continued) 



Description of Objectives 



Results for OL:<ectlves 

Number Feb. April May/ July ^ 
of Items N=22 N=22 N=ll/12 



Results for Composite Objectives 



Nonlnstructlonal Objectives 

Problem-Solving 0-20, 0-99 
add-part part whole (0-99) 
subt-comparlson (11-15) 
8ubt-part part whole-addend (11-15) 
8 ubt- join-addend (0-99) 

Recall of Basic Facts — Speeded Test 
add 0-20 
subt 0-20 

Algorithms — Timed Test 
addition algorithm 
subtraction algorithm 



Number 
of Items 



Feb. 

N«=22 



April 
N=22 



1 


55 


68 


64/92 


1 


91 


77 


100/100 


1 


77 


95 


91/83 


1 


45 


73 


64/75 



12 
12 

24 
24 



67 

44 
40 

41 
15 



78 

66 
69 



May /July 
N-11/12 



80/87 

66/94 
52/84 

-/81? 
-/6? 



*Fonn S was used in April and May; Form V was used in February and July. 
^Form S did not assess this objective. 
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Table 10 

Percent Correct for Addition and Subtraction Algorithms 
Timed Tests by Problem Type for Grade 3, Form V 







Percent 


Correct 


Item Type 


Number 
of Items 


Feb. 
N-22 


July 
N-12 




Addition 






2-digit (without regrouping) 


3 


86 


100 


3-digit (without regrouping) 


3 


93 


94 


2-digit (with regrouping) 


6 


49 


89 


3— dicit fwith rettrouDlntt^ 


Q 


ID 


/o 


3 2-digit addends 


3 

Subtraction 


0 


44 


2-digit (without regrouping) 


3 


68 


94 


3-digit (without regrouping) 


3 


33 


89 


2-digit (with regrouping)^ 


6 


8 


75 


3-digit (with regrouping) 


12 


0 


47 



*3 items are 2-digit + 1-digit. 
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Unfortunately, no children were given this test again in April or 
May and only 12 in July. By then performance for those students was 
considerably better. There was still some difficulty with the three 
addend addition problems and the subtraction regrouping problems but 
the increases in every case are striking. 

Cognitive level . The relative performance on the test items for 
children in Grade 1 at different cognitive levels is shown in Table 11. 
There were three children at both cognitive level 1 and 2 but only one 
child at cognitive level 3. The differences In performance for the 
eight composite objectives favor the CL2 group over the CLl group on 
six composites, with some of the differences being quite large. In 
addition, the CL2 students increased in performance from February to May 
over all the objectives but the CLl students improved only in recall of 
facts (see Table C-1 in Appendix C) . The single CL3 child fails to 
fit any pattern. 

For the Grade 2 children, the relative performance for children at 
different cognitive levels is shown in Table 12. There were two children 
at cognitive levels 1 and 3 and five at level 2. In general, the 
pattern shows CL3 children performing better than CL2 children who in 
turn to better than the CLl children. Some of the differences are 
striking, for example, open sentences (58Z-46Z-33Z) and addition facts 
(60X-35Z-24Z). However, there is one anomaly. For the four problem 
solving items, the CLl children did better than either other group (45% 
to 20% and 33%). However, since these children were low on facts, al- 
gorithms, and counting skills, the results suggest that they found 
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Table 11 

Frequency and Percent Correct for Composite Objectives by Cognitive Level 
for all Administration Times for Grade 1, Form K 



ON 



Objectives 


Number 
of Items 


Cognitive 
Level 1 
N-9 


Cognitive 
Level 2 
N=9 


Cognitive 
Level 3 
N=3 


Total 
N=21 


f/% 


trials 


f/% 


trials 


f/% trial;. 


f/% 


trials 


P^ereauialte Tnfltrurtlonfll Oh '^^r^^vpa 




















Numerousness 0—20 


2 


lA/78 


18 


17/94 


18 


4/67 


6 


35/83 


42 


Order Ins 0—20 


0 


16/89 


18 


15/83 


18 


6/100 


6 


37/88 


42 


Instructional Objectives for the S Topics 




















Open Sentences 


2 


7/39 


18 


7/39 


18 


2/33 


6 


16/38 


42 


Sentence-Writing 0-20 


A 


A/11 


36 


9/25 


36 


2/17 


12 


15/18 


8A 


Noninstructional Objectives 




















Problem-solving 0-20 


2 


12/67 


18 


13/72 


18 


4/67 


6 


29/69 


A2 


Counting 


3 


2/7 


27 


16/59 


27 


2/22 


9 


20/32 


63 


Addition /acts Recall — Speeded Test 


9 


2A/30 


81 


6S/80 


81 


11/41 


27 


100/53 


189 


Subtraction Facts Recall — Speeded Test 


9 


2A/30 


81 


A9/60 


81 


8/30 


27 


81/A3 


189 
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Table 12 

Frequency and Percent Correct for Composite Objectives by Cognitive Level 
for all Administration Times for Grade 2, Form S 



Objectives 



Number 
of Iteifls 



Cognitive 
Level 1 
N-6 

tlx trials 



Cognitive 
Level 2 
N=14 

tlx trials 



Cognitive 

Level 3 Total 

N=6 N=26 

tlx trials tlx 



trials 



Numerousness 0-99 


1* 


Llf>l 




O/ JO 


1 L 
±H 


Jf OH 


D 


1 7 /A7 

LI IK) 1 


ZD 


Orderlnft« Place Value 0-9^ 


0 
£, 


j/ / J 


1 0 


ft /ft 
U/U 


oo 

2o 


1 /O 

1/8 


12 


4/8 


52 


Instructional Objectives for the S and 
A Topics 




















Open Sentences 


2 


4/33 


12 


13/46 


28 


7/58 


12 


24/46 


52 


Sentence-writing 0-20, 0-99 
(multiple choice) 


4 


1/4 


24 


11/20 


56 


4/17 


24 


16/15 


104 


Sentence-writing 0-20, 0-99 
(free response) 


4 


9/38 


24 


25/45 


56 


14/58 


24 


48/46 


104 


Algorithms 


2 


1/8 


12 


4/14 


28 


4/33 


12 


9/17 


52 


Hon instructional Objectives 




















Problem Solving 0-20, 0-99 


4 


11/46 


24 


11/20 


56 


8/33 


24 


30/29 


104 


Counting 


3 


6/33 


18 


14/33 


42 


12/67 


18 


32/41 


78 


Addition Facts Recall — Speeded Test 


12 


17/24 


72 


58/35 


168 


43/60 


72 


118/38 


312 


Subtraction Facts Recall — Speeded Test 


12 


16/22 


72 


50/30 


168 


43/60 


72 


109/35 


312 



^o items were administered for the numerousness objective; students had difficulty reading one of the i ^ms due to poor 
quality of the test duplication so data for this item were discarded. 
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answers to the verbal problems using other strategies. The children 
with better arithmetic skills (but not close to mastery) may have 
attempted to use those skills to solve the problems but made errors. 
This explanation is further substantiated by the decrease in performance 
of the CLl children on these items as the year progresses and their 
arithmetic skills improve (see Table C-2 in Appendix C) • 

For the Grade 3 students at different cognitive levels, the re- 
sults are striking but somewhat ambiguous (see Table 13). The CL5-6 
group performed better on all objectives that any other group, and the 
CL2 group was lower than other groups on all the objectives. But the 
CL3 and CL4 groups in between failed to differ in a consistent manner. 
Obviously the defining characteristics between these two groups are 
not related to differences in performance. Most of the differences 
between the CL5-6 group and the CL2 group are large (selecting sentences 
65% to 44%, ordering 68% to 33%, subtraction algorithms 51% to 13%, and 
so forth. 

Summary of Results 

In summary, the picture these data presents is of children strug- 
gling to learn the complex arithmetic skills associated with addition 
and subtraction and to use those skills to solve verbal problems. 
While improvement across and within grades was apparent, the change 
in performance was not synchronous. Children had problems with place 
value even though they correctly answered 3-digit problems. Work on 



ERLC 



45 



Table 13 

Frequency and Percent Correct for Composite Objectives by Cognitive Level 
for all Adnlnlstratlon Tioes for Grade 3, Forms S and V 



Objectives 


Mumoer 
of Items 


Cognitive 
Level 2 
N-12 


Cognitive 
Level 3 
N-20 


Cognitive 
Level 4 
N-18 


Cognitive 
Levels 5,6 
N-17 


Total 
N-67 


f/Z 


trials 


f/Z 


trials 


f/Z 


trials 


f/Z 


trials 


f/Z 


trials 


Prerequisite Instructional Objectives 
























Numerous ness 0-99 


2 


15/63 


24 


29/73 


40 


24/67 


36 


29/85 


34 


97/72 


134 


Ordering, Place Value 0-99 


2 


8/33 


24 


20/50 


40 


14/39 


36 


23/68 


34 


65/49 


^4 


Instructional Objectives for the S and A Topics 
























Sentence-writing 0^20, 0-99 (multiple choice) 


4 


21/44 


48 


42/53 


80 


39/54 


72 


44/65 


68 


146/54 


268 


Sentence-writing 0-20> 0-99 (free response) 


4 


25/52 


48 


49/61 


80 


37/51 


72 


44/65 


68 


155/58 


268 


Monlnstructlonal Objectives 
























Problem Solving 0-20 , 0-99 


4 


34/71 


48 


58/73 


80 


55/76 


72 


58/85 


68 


205/76 


268 


Addition Algorlthms-^Tlmed Test^ 


24 


30/31 


96 


134/51 


264 


111/51 


216 


172/72 


240 


447/55 


816 


Subtraction Algorithms — Timed Test^ 


12 


12/13 


96 


78/30 


264 


55/25 


216 


122/51 


240 


267/33 


816 


Addition Facts Recall — Speeded Test 


12 


65/45 


144 


152/63 


240 


133/62 


216 


162/79 


204 


512/64 


804 


Subtracc'on Facts Recall— Speeded Test 


12 


61/42 


144 


135/56 


240 


126/58 


216 


154/75 


204 


476/59 


804 



*This objective was assessed in February for 22 students representing all cognitive levels (N-12, 20, 18, 17; and in May for 12 
students at all levels except 2 (N-0, 4, 3, 5). It was not assessed in April. 
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algorithms improved even though basic facts were weak. And children 
correctly solved some simple verbal problems with little arithmetic 
competence. 

With one important exception, children who were identified as 
being at a particular cognitive level performed differently than chil- 
dren in other groups. The one exception was the lack of consistent 
differences between groups CL3 and (^LA at Grade 3. It should be noted 
that the CL4 group at Grade 3 also failed to fit an overall pattern on 
the interview tasks (see Romberg, Collis, & Buchanan, 1981). 

Overall, however, it is very apparent that children who differ 
in cognitive processing capacity performed differently regar<iless of 
specific objective, instruction over time, or grade. 

Secondary Analyses 

Upon the completion of this study, we decided to related these 
data to two other sets of data. First, for the third-grade children 
in this study, we decided to relate their performance on the timed 
algorithm probleiFs to the strategies they used to solve verbal problems 
which could be done using those algorithms. The strategy data were 
collected in the interview study reported earlier (Romberg, Collis, & 
Buchanan, 1981). 

Second, since the achievement tests (Buchanan & Romberg, 1982) were 
constructed for a study in the U.S., we decided to contrast the results 
found in this study with the U.S. data. 
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Strategies and performance . The question we were Interested in 
examining was whether or not students who could use the addition and 
subtraction algorithms chose to use them when' solving verbal problems. 
The strategy data on verbal problems were derived from the interview 
study in this sequence of studies. An interview consisted of six 
problem types (tasks) given under different conditions to each student. 
The six types included two problems solvable by addition of the two given 
numbers and four problems solvable by subtraction of the two given 
numbers. The characterization for these six problem types is detailed 
in Moser (1979) and in Carpenter and Moser (1979). Table lA presents 
representative problems in the order in which the problems were adminis- 
tered to the children. The actual wording for each problem type differed 
in each condition, but the semantic structure remained consistent. 

Within each problem, two of three numbers from a number triple 
(x, a) defined by a: + t/ - a, a: < z/ < a, were given. In the two addi- 
tion problems a:, z/ were presented, with the smaller number x always given 
first. In the four subtraction problems, a and the larger addend y were 
presented. The order of presentation of y and a varied among problem 
types . 

For the interviews with third-grade children, the domain of 2-digit 
numbers was included, in the 2-digit domain, two subdomalns were iden- 
tified. In the first no regrouping (borrowing or carrying) was required 
to determine a difference or sum when a computational algorithm was used. 
In the second subdomain, regrouping was required. The i.o regrouping set 
was called the "D" problem set while the regrouping set was referred to 
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Table lA 
Representative Problem Types 



Task 1. Joining 

(Addition) 



Pam had 3 shells. Her brother gave her 
6 more shells. How many shells did Pam 
have altogether? 



Task 2. Separating 

(Subtraction) 



Jenny had 7 erasers. She gave 5 erasers 
to Ben. How many erasers did Jenny have 
left? 



Task 3. Part-Part-Whole 
Missing Addend 
(Subtraction) 



There are 5 fish In a bowl. 3 are 
striped and the rest are spotted. How 
many spotted fish are In the bowl? 



Task 4. Part-Part-Whole 
(Addition) 



Matt has 2 baseball cards. He also haa 
4 football cards. How many cards does 
Matt have altogether? 



Task 5. 



Comparison 
(Subtraction) 



Angle has 4 lady bugs. Her brother Todd 
has 7 lady bugs. How many more lady 
bugs does Todd have than Angle? 



Task 6. Joining Missing 
Addend 

(Subtraction) 



Gene has 5 marshmallows. How many more 
marshmallows does he have to put with 
them so he has 8 marshmallows altogether? 
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as the "E" problems. For the 2-dlglt problems, the sum z was restricted 
to numbers In the 20s and 30s. 

A record of each subject's response to the tasks was compiled 
from the coding sheets. For each task, the four coded entries were 
model, correctness, strategy, and error. This Information was then 
aggregated Into eight Independent general strategy categories for the 
D and E data (nonsentence/dlrect modeling, nonsentence/countlng, nonsen- 
tence/routlne mental operation, nonsentence/nonroutlne mental operation, 
nons^ntence/lnapproprlate, sentence/algorithm, sentence/nonalgorlthm. In- 
^appropriate sentence). For this analysis the nonsentence/routlne mental 
operations and sentence/algorithm categories were combined and contrasted 
with all others. 

In Table 15 each child's data are presented for the addition prob- 
lems requiring no regrouping. Available achievement test scores for 
the first administration (February) and the last (July) are reported. 
This Is followed by whether or not each of the two verbal addition 
problems In the D set were done algorlthmlcally or not. For these 23 
students at time 1, 62 Items were attempted and 57 were correct (92%) 
and In July all 36 Items attempted were correct. With one exception 
(student 517), these students knew how to add 2-dlglt numbers without 
regrouping. 

However, on the Interviews at time 1, algorithms were used only 59% 
of the time (54% correctly). On Interviews 2 and 3, the percent of use 
Increased only to 79% and 72%. 
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Table 15 



Cognitive 



Performance on Achievement Test Addition Algorithm (Nonregrouplng) Items and Use of 
Algorithmic Strategies for Interview Addition Algorithm Tasks — Level D 



Achievement Score 
3 2-dlgit 4> 2-diglt 



Level D Interviews 
2 Addition Tasks 



February 



July 



Interview 1 



Interview 2 



Interview 3 



Level 


ID 


# Attmpt. 


# Corr. 


# Attmpt. 


# Corr. 


Task 1 


Task 4 


Task 1 


Task 4 


Task 1 


Task 4 


2 


5A2 


3 


3 






/ 




/ 


/c 


/ 


/ 




516 


3 


3 


- 




/B 






/ 


/ 






551 


2 


2 


- 


- 








/ 


/ 


/ 




515 


2 


2 


- 


- 


/ 


/ 


/ 


/ 






'J 


sn 
jj± 






o 
J 




J 

r 


J 

V 


J 

V 


J 
y 


J 

r 


J 

Y 




'\9 7 






o 
J 


o 
J 


J 


J 


MA 


MA 


J 
Y 


J 
Y 




525 


3 


3 




















513 


3 


3 


3 


3 
















502 


2 


2 


3 


3 


/ 




/ 






/ 




550 


3 


2 


— 


- 




/ 


/ 


/ 


/ 


/ 




541 


3 


2 


- 


- 


/ 


/ 


NA 


NA 


/ 


/ 


A 
H 




J 


J 






/ 


/ 


/ 


J 


J 
Y 


J 
Y 




^/i 7 
Dh / 


J 


o 
J 






/ 

V 




Jji 

YD 










543 


3 


3 


3 


3 


/ 


/ 


/ 


/ 


/ 


/ 




534 


3 


3 


3 


3 






/ 


/ 


/ 


/ 




512 


2 


2 


3 


3 






/ 


/ 


/ 






517 


3 


1 






/c 


/ 


/ 


/B 






5,6 


528 


3 


3 


3 


3 




/ 


/ 


/ 


/ 


/ 




549 


3 


3 


3 


3 


/ 




/ 




/ 


/ 




526 


3 


3 






/ 




/ 


/ 


/ 


/ 




536 


3 


3 


3 


3 


/ 




/ 


/ 


/ 


/ 




530 


3 


2 


3 


3 




/ 


/ 


/ 


/ 


/ 




538 






3 


3 


/ 


/ 


/ 


/ 


/ 


/ 



Key: NA ^ not administered 

/ ■ algorithmic strategy » correctly used 

/B « algorithmic strategy^ "buggy" error 

/C « algorithmic strategy, computational error 

algorithmic strategy, reverse operation error 

52 " algorithmic strategy, unknown error 
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similar data for addition with regrouping is shown in Table 16. 
In this case, six achievement items (three 2-digit plus 1-dlgit items 
and three 2-digit plus 2-digit items) were administered and contrasted 
with the two verbal addition problems in the E set. At time 1 students 
attempted 95 items and got 66 correct (69Z) and by time 2 they attempted 
71 items getting 66 correct (90Z) . Thus, while there was some diffi- 
culty with regrouping at the start of the year, by July, with the excep- 
tion of student 512 who made six errors in six problems, the students 
all could add with regrouping. 

The interview data show that in spite of this level of performance, 
many students did not use the algorithms to solve verbal addition 
problems. On the interview 1 tasks, about half (54Z) of the children 
tried using an algorithm (A6Z correctly). On the second interview, this 
had changed to 60Z using an algorithm (48% correctly) and by interview 3 
78Z used an algorithm with no errors. 

For subtraction without regrouping, performance on three achieve- 
ment items is contrasted with strategies used on the four verbal sub- 
traction problems. (See Table 17.) At time 1, 55 items had been 
attempted with 45 being correct (82%) and by time 2, j4 36 attempt, 
were correct (94%). In fact, only one student made any errors in July. 
One can conclude that these students were able to subtract without re- 
grouping. However, on the four verbal subtraction problems only 14% 
of the strategies used were algorithms (only 9% correct) at the start 
of the year. By the second interview, this had increased to 25% and 
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Table 16 

Perfonance on Achievement Test Addition Algorithn (Regrouping) Items and use of 
Algorithmic Strategies for Interview Addition Algorithm Tasks— Level E 



Cogniffe 
Level 



5,6 



Key: 



ID 



February 



Achievement Score 
3 2-<llglt -I- l^digit 



July 



February 



Achievement Score 
3 2-digit ^ 2^i8it 



Level £ Interviews 
2 Addition Tasks 



July 



Interview 1 



mterviev 2 



Interview 3 



# Attmpt. # Corr. # Attapt. _Tr # Attmpt. # Corr. # Atimpt. # Corr. Task 1 Task 4 Task 1 Task 4 Task 1 Task 4 



542 3 


2 






3 


2 






J 

w 








J 

w 




551 3 


2 






0 


0 












/ 


J 

w 


r 


516 1 


0 






3 


0 














/ 


/ 


515 0 


0 






0 


0 






/ 




/? 


/ 






531 3 


3 


3 


3 


3 


3 


3 


3 


/ 


/ 


/ 


/ 


/ 


/ 


550 3 


3 






3 


2 










I* 




/ 




541 0 


0 






3 


3 






/ 


/ 


NA 


HA 


/ 


/ 


527 2 


1 


3 


3 


0 


0 


3 


2 


/ 




NA 


NA 


/ 


/ 


525 3 


0 






1 


0 


















513 2 


0 


3 


3 


2 


0 


2 


2 














502 2 


0 


3 


3 


0 


0 


3 


3 










/ 


/ 


548 3 








3 


3 






/ 


/ 


/C 


/ 


/ 


/ 


547 3 








2 


2 








/ 






/ 




543 3 




3 


3 


2 


2 


3 


3 


/ 


/ 


/ 


/ 


/ 


/ 


517 3 








2 


0 








/b 


/C 




/ 




534 3 




3 


3 


0 


0 


3 


3 






/ 


/ 


/ 


/ 


512 1 




3 


0 


0 


0 


3 


0 






/ 


/ 


/ 


/ 






3 


3 


3 


y 


3 


3 


/ 


/ 


/ 


/ 


/ 


/ 


5ju 3 




3 


3 


3 


3 


3 


3 


/ 


/ 


/ 


/ 


/ 


/ 


^49 3 




3 




3 


3 


3 


3 


/% 


/ 






/ 




526 3 








3 


2 






/ 


/ 


^ 


/ 


/ 


/ 


530 3 




3 


3 


3 


0 


3 


3 






/ 


/C 


/ 


/ 


538 




3 


3 






3 


3 


/ 


/ 


/ 


/ 


/ 


/ 



NA 

/ 

/B 

/C 



not administered 

algorithmic strategv^ correctly used 

alsorithmlc strategy, "Buggy" error 

algorithmic strategy, computational error 



/O ■ algorithmic strategy, reverse operation error 
/? - algorithmic strategy, unknown error 
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Table 17 





Performance on Achievement Test Subtraction Algorithm (Nonregrouping) Items and Uf ^ of 






Algorithmic Strategies for Interview Subtraction Algorithm Tasks — Level D 










Achievement 


Score 






Level D Interviews 










3 2-digit - 


2 digit 






4 Subtraction Tasks 


1 


Cognitive 




Februai 


■y 


July 






Interview 1 




Level 


ID 


# Attmpt. 

_ L 


# Corr. # 


Attmpt. # 


Corr. 


Task 2 


Task 3 Task 5 


. c O \J 


2 


515 


3 


3 


_ 






/ 






542 


3 


3 


- 


- 


/B 


/B 






516 


3 


3 


- 


— 










551 


3 


0 












3 


531 


3 


3 


3 


3 


/ 


/ 


J 
r 




550 


3 


3 














502 


3 


3 


3 


3 










525 


3 


3 




- 










513 


3 


3 


3 


1 










527 


0 


0 


3 


3 


/ 


/ 
/ 






541 


0 


0 








4 


534 


3 


3 


3 


3 


/B 








547 


3 


3 












543 


3 


2 


3 


3 


/ 








517 


2 








/C 


/o 






548 


1 


0 






/B 








512 


1 


0 


3 


3 








5,6 


528 


3 


3 


3 


3 










530 


3 


3 


3 


3 










536 


3 


3 


3 


3 


/ 








526 


3 


2 












549 


3 


2 


3 


3 










538 






3 


3 
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Table 17 (continued) 



Level D Interviews 
4 Subtraction Tasks 



Cognitive Interview 2 Interview 3 



Level 


ID 


Task 2 


Task 3 


Task 5 


Task 6 


Task 2 


Task 3 


Task 5 Task 6 


2 


515 




/ 














542 










/ 








516 






/ 












551 










/ 






3 


531 










/ 


/ 


/ 




550 


/ 








/ 








502 


/ 




/ 












525 


/ 
















513 


















527 


NA 


NA 


NA 


NA 


/ 








5A1 


NA 


NA 


NA 


NA 


/ 


/ 


/B 


4 


53A 










/ 


/ 






5A7 










/ 


/ 






5A3 


/ 








/ 


/ 


/ / 




517 


/ 
















5A8 




/ 








/ 






512 
















5,6 


528 




/ 






/ 


/ 


/ / 




530 


/ 


/ 


/ 


/ 


/ 








536 










/ 








526 


/ 








/ 








5A9 


✓ 








/ 








538 


/ 


/ 


/ 


/ 


/ 


/ 


/ / 



NA " not administered 

/ ■ algorithmic strategy, correctly used 

■ algorithmic strategy, "buggy" error 
/C ■ algorithmic strategy, computational error 
/O ■ algorithmic strategy, reverse operation error 
/? ■ algorithmic strategy, uxiknown error 
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finally to 34Z by the third interview. Furthermore, over half of the 
total attempts (59%) were just on Task 2 (simple separate), the most 
obvious subtraction problem. 

The same pattern, only more pronounced, occurred for the subtrac- 
tion with regrouping contrast. (See Table 18.) There were six sub- 
traction achievement problems (three 2-digit minus 1-digit items and 
three 2-digit minus 2-digit items) . At the start of the year only 38 
items were attempted and only 12 were correct (32%) . Many children 
managed only to complete the first six no-regrouping tiems in this 
timed test so that we have no measure of their capability. However, 
while it is hard to imagine why they were so slow, one can only assume 
that they would have been unable to do the regrouping problems had 
they attempted them. However, by the second administration (July), 
66 items were attempted and 54 were correct (82%). Also, only two 
students (502 and 513) made more than one error on the six problems. 
Thus, while there was evidence of considerable difficulty in subtract- 
ing with regrouping in February, by the end of the Autumn term most 
were capable of using c subtraction algorithm. 

But again, in spite of knowing algorithmic procedures, most children 
did not attempt to solve verbal problems using them. On the first inter- 
view, algorithms were used on only 13% of the tiems (5% correctly) . On 
the second interview, this had increased to 23% (11% correctly) , and 
by the third interview, it was 35% (26% correctly). And, as with sub- 
traction no-regrouping, most of the attempts were on the simple separat- 
ing tasks (44%) . 
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Table 18 

Performance on Achievement Test Subtraction Algorithm (Regrouping) Items and Use of 
Algorithmic Strategies for Interview Subtraction Algorithm Tasks — Level E 



Achievement Score Achievement Score 

3 2-digit - 1-digit 3 2-digit - 2-digit 

Cognitive February July February July 

Level ID t Attmpt> # Corr> # Attmpt, t Corr, // Attmpt, // Corr, Attmpt, # Corr, 



551 


3 


0 






3 


0 






542 


0 


0 






1 


0 






516 


0 


0 






0 


0 


— 




515 


0 


0 






0 


0 






CO! 

531 


3 


2 


3 


3 


0 


0 


3 


3 


DUZ 


<> 
Z 


2 


3 


1 


0 


0 


3 


2 


7 

DZ / 


t 
i 


2 


3 


3 


0 


0 


3 


3 


541 


2 


0 






0 


0 






525 


0 


0 






0 


0 






513 


0 


0 


3 


0 


0 


0 


3 


0 


550 


0 


0 






0 


0 






543 


3 


0 


3 


3 


2 


0 


3 


3 


534 


0 


0 


3 


3 


0 


0 


3 


3 


547 


0 


0 






0 


0 






517 


0 


0 






0 


0 






548 


0 


0 






0 


0 






512 


0 


0 


0 


0 


0 


0 


0 


0 


528 


3 


3 


3 


3 


0 


0 


3 


3 


549 


2 


2 


3 


3 


3 


0 


3 


2 


530 


3 


1 


3 


3 


0 


0 


3 


3 


526 


3 


0 






3 


0 






536 


0 


0 


3 


2 


0 


0 


3 


2 


538 






3 


3 






3 


3 
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Table 18 (continued) 



Cognitive 



Level E Interviews 
4 Subtraction Tasks 



Interview 1 



Interview 2 



Interview 3 



Level 


ID 


Task 2 Task 3 Task 5 Task 6 


Task 2 


Task 1 


Task 5 


Task fi 






X aolx J 


X asK 0 


2 


551 












/ 










542 


/B /B 










/ 


/ 








516 


✓0 /b /b 


/b 








/ 


/ 


/C 


/B 




515 




/B 




/B 


/c 








3 


531 


/ 








J 

r 


J 

V 


r U 








502 


















J 

w 




527 




NA. 


NA 


NA 


NA 


/ 


^/B 




/ 




541 




NA 


NA 


NA 


NA 


/ 


/ 


/B 






525 






















513 






















550 


/? 


/B 
















4 


543 




/ 








J 

r 




J 

w 


J 




534 












/ 










547 






















517 




/B 


/O 


/B 


/? 












548 


/ 


/ 


/ 


/ 


/ 


/ 






/ 




512 
















/ 




5,6 


528 


/ / 










/ 


/ 








549 




/ 








/C 










530 






















526 


/o 


/B 








/ 










536 












/B 










538 


/ 


/ 






/ 


/ 


/ 




/ 



Key: 



NA 

/ 

/B 

/C 
/O 
/? 



not administered 
algorithmic strategy^ 
algorithmic strategy » 
algorithmic strategy^ 
algorithmic strategy^ 
algorithmic strategy^ 



correctly used 
"buggy" error 
computational error 
reverse operation error 
unknown error 
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Also on this set of verbal problems » the CL2 students make the 
most total attempts to use algorithms (35% of the time), even though 
they got no Items correct on the achievement test but have the most 
errors (only 10% correct). The CL5,6 students attempted to use algor- 
items 22Z of the time and got 17% correct. 

Overall, this relationship between skill of doing addition and 
subtraction algorithms and using the algorithms to solve verbal problems 
is interesting. These third-grade students use other strategies (count*- 
ing, fingers, and so forth) until they become really confident in 
using the algorithms. The children who are confident in all four 
symbolic situations are more likely to use algorithm? than children 
who experience some difficulty. However, the problem structures (ver- 
bal semantics) clearly influence how problems are worked* 

Tasmanian vs> Wisconsin data . We were able to contrast the 
achievement test data gathered in Sandy Bay and somewhat comparable 
data from Wisconsin, There are several factors which preclude drawing 
firm conclusions from this comparison* 

First, for Grade 1, in particular, the status of the children in 
the school yf^ar was different. The Wisconsin students had already had 
instruction for three months* Second, the Wisconsin data are based on 
three forms and the Tasmanian data on one form* Third, the Wisconsin 
data are based on all children in several classes, the Tasmanian data 
on a carefully selected sample* And fourth, the Wisconsin data were 
based on a sample of children following a specific mathematics program 
with the achievement tests being written to assess the effects of its 

Er|c ^ 66 
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use (Romberg, Carpenter, & Moser, 1978). The Tasmanian children were 
being instructed in a more conventional mathematics program. 

The comparable percent correct on composite objectives is shown for 
Grades 1, 2, and 3 in Tables 19, 20, and 21. Comparisons in those 
tables are shown in terms of approximately the same time in the school 
year. (Recall the U.S. school year starts in September, the Australian 
in February.) 

At Grade 1 only one direct comparison is reasonable and the data 
indicate similar levels of performance on four composite objectives and 
higher performance for the Sandy Bay children on four composites. 

At Grade 2 a different picture is evident. The Tasmanian children 
are much behind the Wisconsin Grade 2 children at the start of the year. 
On most objectives they show substantial improvement and nearly catch 
up three months later. This is probably due to instruction. 

Finally, at Grade 3 the Wisconsin children perform somewhat better 
on most objectives than the Sandy Bay children in April and May/ July. The 
only conclusion we are willing to draw is that the observed differences 
are most likely due to differential instructional emphasis. 
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Table 19 

Percent Correct for Composite Objectives at Comparable Administration Times 
for U.S. and Sandy Bay Children — Grade 1 



Objective 



Site 



Feb. 



April 



Baseline 
May 



S-1 



S-2 



S-3 



Prerequisite Instructional Objectives 
Numerous ness 0-20 

Ordering 0-20 

Instructional Objectives for the S Topics 
Open Sentences 

Sentence-writing 0-20 

Noninstructlonal Objectives 
Problem-solving 0-20 

Counting 

Addition Facts Recall — Speeded Test 
Subtraction Facts Recall — Speeded Test 



U.S. 

Sandy Bay 

U.S. 

Sandy Bay 



U.S. 

Sandy Bay 

U.S. 
Sandy Bay 



U.S. 
Sandy Bay 

U.S. 

Sandy Bay 

U.S. 
Sandy Bay 

U.S. 

Sandy Bay 



86 
93 

29 
21 

64 
19 
33 

2!( 



71 
86 

36 
11 

57 
33 
49 
44 



95 
93 

85 
86 



27 
50 

22 
21 



63 
86 

43 
43 

51 
76 

33 
56 



94 
94 

51 
41 

70 
42 
56 
44 



97 
95 

74 
54 

76 
49 
69 
55 



99 
95 

78 
60 

81 
52 
77 
65 



68 
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Table 20 

Percent Correct for Composite Objectives at Cc-nparable Administration Times 
for U.S. and Sandy Bay Children — Grade 2 



Objective 



Site 



S-4 
Feb, 



Prerequisite Instrjictional Objectives 
Numerousness 0-99 

Ordering, Place Value 0-99 

Instructional Objectives for the S and A Topics 
Open Sentences 

Sentence-writing 0-20, 0-99 (multiple choice) 
Sentence-writing 0-20, 0-99 (free response) 
Algorithms 

Noninstructional Objectives 
Problem-Solving 0-20, 0-99 

Counting 

Addition Facts Recall—Speeded Test 
Subtraction Facts Recall — Speeded Test 



U.S. 

Sandy Bay 

U.S. 

Sandy Bay 



U.S. 

Sandy Bay 

U.S. 
Sandy Bay 

U.S. 

U.S. 
Sandy Bay 



U.S. 

Sandy Bay 

U.S. 
Sandy Bay 

U.S. 

Sandy Bay 

U.S. 
Sandy Bay 



70 
56 

43 
6 



85 
17 

59 
17 

65 



41 
11 



60 
22 

67 
30 

63 
29 

51 

23 



S-5 
April 



76 
67 

47 
0 



91 
39 

65 
14 

73 
53 

52 
17 



70 
39 

71 
33 

74 
35 

61 

30 



S-6 
May 



A-1 



A-2 



82 
75 

46 
19 



89 
88 

69 
16 

77 
59 

52 
25 



67 
25 

73 
63 

79 
51 

65 
54 



87 
54 



78 
46 



80 
64 



92 
55 



75 
62 



81 



67 



Table 21 

Percent Correct for Composite Objectives at Comparable Administration Times 
for U.S. and Sandy Bay Children — Grade 3 



Objective 



Site 



Feb. 



A- 3 
April 



A-4 
May /July 



72 



Prerequisite Instructional Objectives 
Numerousness 0-99 

Ordering, Place Value 0-99 

Instructional Objectives for the S and A Topics 
Sentence-writing 0-20, 0-99 (multiple choice) 

Sentence-writing 0-20, 0-99 (free response) 

Nonlnstructlonal Objectives 
Problem-Solving 0-20, 0-99 

Addition Algorithms — Timed Test 

Subtraction Algorithms — Timed Test 

Addition Facts Recall — Speeded Test 

Subtraction Facts Recall — Speeded Test 



U.S. 
Sandy Bay 

U.S. 
Sandy Bay 



U.S. 
Sandy Bay 

U.S. 
Sandy Bay 



U.S. 
Sandy Bay 

U.S. 
Sandy Bay 

U.S. 
Sandy Bay 

U.S. 
Sandy Bay 

U.S. 

Sandy Bay 



68 
30 

41 
39 

67 
41 
15 
44 
40 



93 
61 

54 
70 



85 
61 

85 
64 



85 
78 

76 



52 

91 
66 

84 
69 



95 

82/92 

69 

32/58 



88 

41/83 

90 
64/81 



88 

80/87 

86 
— /81 

62 
~/65 

93 

66/94 

90 
52/84 



73 
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Appendix A 
ACHIEVEMm MONITORING TESTS 
FORMS K, S, Al^ V AND DIRECTIONS 
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K 

50 Directions for Adrainistcring Achievement Monitoring Test K 

Coordinated Study 91 

General Directions 

Reading the Test . This test is read aloud to the children. Read the 
questions exactly as they are printed in the directions; do not paraphrase. 
Each question is read twice — or the key phrases are repeated after the 
original question is read. Read the questions at a somewhat slower than 
conversational pace. The second part of the test, the basic facts speed 
testy will be administered via tape. 

Since many children will not know how to do the majority of the test, 
especially at the beginning of the study, they will no doubt want to ask 
questions or want you to repeat items ye^: again. Please do not allow 
this — instead, ask them to answer "as best they can" or to mark the 
*'puzzled face." Note also that reading the answers to the children (with 
the exception of row I) is not advisable; for example, a child may ask 
what "28" is, or what a "+" sign is— it is considered part of the test 
to know (or not know) what "28" or "+" is! 

Since this is a group-administered test, verbal exchanges with individual 
children can be distracting and interfering — try to establish a policy 
of not talking and not allowing the children to talk in between 
questions. 

Should the above directions seem unnecessarily stringent, please realize 
that we are attempting to measure change over time and that we have very 
few questions on which to base this measurement. The children will take 
the other forms of this same test at 6 week intervals and then they will 
repeat the first form; hopefully each time they will be able to answer 
the questions more successfully. 

Monitoring the Test . It is very desirable to have another adult in the 
room to help the children keep their places and to respond (as indicated 
above) to the inevitable questions. Both the test administrator, if 
possible, and the monitor should move about the room making sure that 
the children mark only one box in each row and also encouraging them to 
mark at least one box (the "puzzled face" if they do not know the answer). 
Monitoring is essential for the second part of the test, the taped basic 
fact items, to help the children keep their places. 

Pacing the Test . Especially for the number story problems (questions G-H), 
it may take a "long" time for the children to figure out an answer. As 
a rule of thumb, allow the group to work on each question until only one 
ox two children are still working. At that point, if necessary, suggest 
that anyone still working mark the "puzzled face" box. Tlien go on to the 
next question by sayi "Find Row ." 

The second part of the test, the taped basic Tacts questions is a 

speed test. Once the tape is started, it will not be stopped. You will 
find the directions for administering this section on page . 
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Preparations for Testing 

Ask the children to clear their desks except for two pencils with 
erasers (or a separate eraser) . They will not need scratch paper for 
this test. The children's names have been written on the tests In advance; 
distribute the teats, making sure each child has his/her own test* 



Specific Directions 



SAY: Today we are going to do some work In this booklet. You have already 
learned how to do some parts of the work. But, you have not learned 
how to do other parts yet. I don't expect you to know how to do all 
of the work now. I will come back next month, and again and again 
while you are In first grade • . . each time you will have learned 
how to do more of the work* 



EXAMPLE A 



EXAMPLE B 



Find your name on the line. Look at the little box after your name. 
It has an X In It. Look at the big box right next to the little box. 
Use your pencil and make a big X In the big box* Try to make your X 
come all the way to the comers of the box. [Check to see that the 
children have filled in the practice box correctly.] 

Sow find the first row of boxes, row A. Put your finger by the A* 
[Pause. ] I am going to ask you a question. You will answer by mak- 
ing a big X In one of the boxes. If you don't know the answer, you 
may make an X In the last box, the one with a puzzled face. 

Look at the pictures In row A. Which box has a fish In It? Make 
an X In the box that has a fish In It. [Pause. ] Remember, If you 
don't know the answer, make an X In the last box, the one with a 
puzzled face. [Chech to see that the children mark only one box in 
the row. ] 

Now find the next row of boxes, row B. Put your finger by the B. 
[Pause. ] Look at the shape In the arrow. Make an X In the box that 
has a shape just like the shape In the arrow • • . make an X In the 
box that has a shape just like the shape In the arrow. [Pause.] 
Remember, If you don't know the answer, make an X In the box with a 
puzzled face. [Check to see that the children mark only one box in 
the roD. ] 



Now turn to the next page and fold your booklet, like this. 
[Demonstrate, folding the cover page under. ] Put your finger by 
row C. [Make sure all children are on page Kl, row C. ] Look at 
C the number In the arrow, tlake an X In the box which has that many 

turtles In It . . . make an X In the box that has that many turtles 
In It. [Pause.] Remember, If you don't know the answer, mark the box 
with a puzzled face. 

[Note: Starting with row C, do not assist the children with the test, 
except to make sure they are marking only one box . . . and at least 
one box. You may help with the words for row I. ] 



[Repeat, Hf you don't know the answer, make an X in the box with 
Q the puzzled face," frecpientlu throughout the test. ] 
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Find row D* Look at the kittens In the arrow. Make an X In the box 
that tells how many kittens there are • • • make an X In the box that 
tells how many kittens there are. 

Find row E* Look at the ntonber sentence ii the arrow Make an X 
on the missing number that will make the sentence true • • • make an 
X on the missing number that will make the sentence true. 

Find row F. Look at the number sentence In the arrow. Make an X 
on the missing number that will make the sentence true • • • make 
an X on the missing number that will make the sentence true. 

Now turn to the next page and fold your booklet, like this. 
[Demonstrate. ] Find row G. [Make sure all children are on page 
row G.] I am going to read a number story about toy airplanes. I 
will read the story twice. Listen both times before you mark a box. 
David has 9 toy airplanes. His sister Nancy has 13 toy airplanes. 
How many more toy airplanes does Nancy have than David? [Pause. ] 
David has 9 toy airplanes. His sister Nancy has 13 toy airplanes. 
Bow many more toy airplanes does Nancy have than David? [Alia) 
plenty of time for the children to figure out their answers to 
rem G cmd H. If necessary, remind them to use the ^^face^^ box when 
they don^t know the answer. \ 

Bow H. This nuniber story is about cupcakes. I will read the story 
twice. Listen both times before you mark a box. Tom has 2 chocolate 
cupcakes. He also has 3 white cupcakes. How many cupcakes does Tom 
have altogether? [Pause. \ Tom has 2 chocolate cupcakes. He also 
has 3 white cupcakes. How many cupcakes does Tom have altogether? 

Bow I. Look at the cups and saucers in the arrow. Are there the 
same number of cups as saucers . . . the same number of cups as 
saucers? [If necessary, read the answer choices to ' children. ] 

Bow J. Look at the numbers in the arrow. What number should come 
next . . . what nuinber should come next? 

Now turn to the next page and fold your booklet, like this. 
{Demonstrate. Make sure all children are on page K2, row K. ] The 
work on this page is quite hard. Mark the puzzled face if you do 
not understand how to do the work. Find row K. Look at the nimiber 
sentences. [Pauee.] One of the number sentences tells how to find 
the answer for this story about pennies. After I read the story, 
make an X on the nuinber sentence that tells how to find the answer. 

Sarah has 5 pennies. Her brother Ricky has 7 pennies. How many more 
pennies does Ric!;y have than Sarah? [Pause.] Sarah has 5 pennies. 
Her brother RicLy has 7 pennies. How many more pennies does Ricky 
have than Sarah? 
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[Note: Most children in the early test periods will no doubt 
be confused by rows K-N; don't be too hasty j however j about 
having them mark the "face'J^ box. We may have a few children 
who somehow can interpret - sentences. ] 

Row L. This number story is about hats. After I read the story 
twice» mark the number sentence that tells how to find the 
I- answer. Karla had 15 hats. She gave 9 hats to Steve. How many 

hats did Karla have left? [Pause.] Karla had 15 hats. She 
gave 9 hats to Steve. How many hats did Karla have left? 

Row M. This number story is about links. Mark the number sentence 
that tells how to find the answer. Patty made a chain of links. 
She used 3 links first. Then she used 8 more links. How many 
links long is her chain? [Pause.] Patty made a chain of links. 
She used 3 links first. Then she used 8 more links. How many 
links long is her chain? 

Row N. This number story is about things to drink. Mark the number 
sentence that tells how to find the answer. There are 11 glasses 
jl on the table. 5 have orange juice in them. The rest have milk 

in them. How many glasses have milk in them? [Pause. ] There 
are 11 glasses on the table. 5 have orange juice in them. The 
rest have milk in them. How many glasses have milk in them? 

Now turn to the next page and fold your booklet like this. [Demon- 
strate.] Find row 0. [Make sure all children are on page K4j row 0.] 
0 We are going to count up from the number 12. When we count up one 

number from 12 we get 13. When we count up two numbers from 12 we 
get 14. What do we get when we count up five numbers from 12 . . . 
what do we get when we count up five numbers from 12? 

Row P. Look at the garage and the cars. There are 15 cars 
altogether. We can see some cars outside the garage. The 
P rest are ir Ide the Rara^e. How many cars are inside the 

garage? . . . There are 15 cars altogether . . . some are outside . . . 
the rest are inside . • . how many are inside? 

Row Q. I am going to tell you about som^^ 'umbers . . . listen 
Q ... 24 comes 1 number after 23 ... 25 comes 2 numbers 

after 23 • • . what number comes 6 numbers after 23 . . . 
what number comes 6 numbers after 23? 

Turn to the last page. 



ERLC 



K 



54 

The vork on this page is different. I want to see how quickly you can 
think of answers in your mind. You will not have time to use your fingers 
to figure out the answers. 

I am going to play a tape — the voice on the cape will say problems, like 
this: [Play the four sample problems.] The problems go quickly. Today 
you probably will not know very many answers, but when I come back and 
we do these problems again, you will know more. Don't feel bad if you 
don t know the answers today. 

the voice on the tape will tell you where to write your answers. Get 
your pencil ready. [Start tape.] 

Script on Tape ; Look at the long rov of boxes. Find box A. I am going 
to say problems like 1 + 1. The answer for 1 + 1 is 2. So there is 
a 2 in box A. Find box B. What is 2 + 2? 2 + 2 is 4. You write a 
4 In box B. 

[There is a 20 second pause here. Move about the room and make sure the 
children are working in the top row on the page. ] 

Now I am going to say problems for all the rest of the boxes in this row. 
I will not stop. Don't try to figure out the answer with your fingers. 
If you can't think of the answer quickly in your mind» leave the box 
empty. Ready? 

Box C 3+1 
Box D 2 + 5 
Box E 1 + 6 
Box F 7 + 2 



FORM K 



Box G 2 + 6 

Box H 3 + 5 

Box I 4 + 8 

Box J 3 + 7 

Box K 5 + 9 
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Stop vorklng • • • stop working. You may rest for a minute • • • then ve 
vUl vork on the row of circles. 
[There is a 20 oeoond pause here. ] 

Ready to listen ags^ln? Find the ruv of circles. Put your finger under 

Circle A. This time I am going to say problems like 4 take away 1. The 

answer for 4 take away 1 is 3. So there Is a 3 In circle A. Find circle B. 

What Is 2 take away 1? 2 take away 1 Is !• You write a 1 In circle B«. 

[There is a 20 second pause here. Move ihout the room and make sure the children 
are working on the bottom row. ] 

Now I am going to say problems for the rest of the circles. I will not 
stop. If you can*t think of the answer quickly In your mind, leave the 
circle empty. Ready? 

Circle C 7-1 
Circle D 8-4 
Circle E 9-5 
Circle F 7-4 

FORM K 

Circle G 8-6 
Circle H 4-3 
Circle I 11-2 
Circle J 13-8 
Circle K 12-7 

Stop working . . . stop working. Put your pencil down. Turn back to the 
pn'je wrth your name on It, 
[Stop the tape.] 

That Is all the work we will do today. Remember, I will come again and 
you will do work like tuts aga^n. Each time I come, you will be able to 
do more of the work. 

[Collect the booklets.] 
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Directions for Administering Achlevcaent Monivorlng Test S 
Coordinated Study ^1 & If2 

General Directions 

Reading the Test , The first part of this test Is in mu? Iple choice fomat 
and is read aloud to the children. Read the questions exactly as they are 
printed in the directions; do not paraphrase. Each question is read twice — 
or the key phrases are i^epearcd after tne original question is read. Read 
the questions at a somewhat slower than conversational pace. The second 
part of the test involves verbal problens for which the child aust write, 
but not solve, a number sentence. Again, you will read the nunber story 
twice. The third part of the test, the basic facts speed test» .will be 
administered via tape. 

Since oany children will not know how to do the tnajorlty of ':he test, 
especially at the beginning of the year, they will no doubt want to ask 
questions or want you to repeat items yet again. Please do not allow 
thl8~instead, ask thea to answer ''as best they can" or to mark the 
^puzsled face" to show they have "not learned this yet." Note also that 
reading the answers to the children is not pcnnitted. 

Since this is a group-adaini^; ered test, verbal exchanges with individual 
children can be distracting and interfering — try to establish a policy 
of not talking and not allowing the children to talk in between questions. 

Should the above directions seem unnecessarily stringent, please realize 
that ve are attempting to measure change over time and that we have very 
few questions on which to base this measurement. The children will take 
the other forms of this same test at 6 week intervals and then they will 
repeat the three forms; hopefully each time they will be able to answer 
the questions more successfully. 

Hake sure the children mark only one box and that they mark at least one 
box. Encourage them to use the "puzzled face" by reminding them that this 
response means "I haven't learned this (how to do this) yet." 

Facing the Test . Try to keep the test moving. Expecially for the number 
story and algorithm problems it may take a "long" time for the children to 
figure out an answer. As a rule of thumb, allow the group to work on each 
question until only one or two children are still working. At that point. 
If necessary, suggest that anyone still working mark the "puzzled face" 
box. Then just go on to the next question without waiting longer. The 
second part of the test, sentence vrriting, may go slowly. Remind the children 
BSit to solve the problem, and again, to use the "puzzled face" when they need 
to. The third part of the test, the taped basic facts questions is a speed 
test. Once the tape is started* it will not be stopped. 
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Preparations for Testing 

The children will need two pencils with erasers. They will not need scratch 
paper for this test, since they will viite in the **arrov** space. The children's 
names have been written on the tests in advance; distribute the tests, making 
sure each child has his/her own test. 

Specific Directions 

SAT: Today ve are going to some work with numbers in this booklet. You 

learned how to do some parts of the work last year in first grade. You 
vlll learn how to do more of the work this year in second grade. We don't 
expect you to know how to do all of the work today. Ue will come back 
Again and again while you are In second grade • • • each time you wtll 
have learned how to do more of the work. 

Find your name on the line. Look at the big box. with an X in lt~ 
you will answer the questions today by making a big X like this one. 



EXAMPLE 



Nov find row A. I am going to ask you a question. You will answer 
by making a big X in one of the boxes. If you haven't learned about 
the answer yet, make an X in the last box, the one with the puzzled 
face. [Peruse. ] 



EXAMPLE 



Vhich box has the tallest flag in it? Make an X on the box with the 
tallest flag. [Pause.] If you haven't learned about this yet, make 
an X In the last box, the one with the puzzled face. [Check to see 
that the children mctrk only one box in the row. ] 

Find row B. Look at the number in the arrow. Make an X on the box 
vhich has that many socks in it ... the box which has that many socks 
in It. If you haven't learned about this yet, mark the puzzled face. 

Nov turn to the next page and fold your booklet. 

[Note: Starting with row do not assist the children with the test, 
except to make sure they are tnarking only one box . . . and at least 
one box.] 

Rov C. Look at the sticks in the arrow. Make an X on the box that 
tells how many sticks there are ... the box that tells how many sticks 
there are. [Pause.] Remember, if you haven't learned about this yet, 
nark the puzzled face. 
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Row D. Make an X on the box that has 24 cubes in it 



2A cubes in it< 



Rov E. Look at the number sentence in the arrow. Make an X on the 
number that will make the sentence true ... make an X on the number 
that will make the sentence true. 
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Row F. Look at the runber sentence in the arrow. Make an X on the 
number that will make the sentence true • • • make an X on the number 
that will make the sentence true. 

Row G. I am going to read a number story about toy airplanes. I 
will read the story twice. Listen both times before you mark a box. 
David has 9 toy airplanes. His sister Nancy has 13 toy airplanes. 
How many more toy .airplanes does Nancy have than David? [IJepeat. 
Allcw time for the children to figure out their answers to raws G 
and B.] 

Row I!. This number story is about bottle caps. For this story you may 
write on the paper if you want to. Tom has 24 old bottle caps. He also 
has 57 new bottle caps. How many bottle caps does Tom have altogeth?r? 
[Repeat. If necessary, remind the children to ^'make an X" on their 
answer. Also, use the ^'puzzled face'* reminder as necessary.] 

Row I. Khich box shows the numbers in order from smallest to largest .. 
in order from smallest to largest? 

Row J. Look at the little squares in the arrow. Make an X on the box- 
that tells hov many squares there are... how many squares there are. 

Row K. Look at the number sentences. One of the number sentences 
tells liow to find the answer for this story about hats. After I 
read the story, make an X on the njmber sentence that tells how to 
find the answer. Karla had 15 hats. She gave 9 hats to Steve. Hov 
many hats did Karla have left? [Repeat.] 

Row L. . This number story is about stickers. Make an X on the number 
sentence that tells how to find the answer. Sarah has 28 stickers. 
Her brother Ricky has 34 stickers. How many more stickers does Ricky 
have than Sarah? [Repeat. ] 

Row M. This number story is about things to drink. There are 11 
glasses on the table. 5 have orange juice in them. The rest have 
milk in them. How many glasses have milk in them? [Repeat. ] 

Row N. This number story is about children swimming. There were 46 
children swimming in the pool. 27 more children jumped into the pool. 
Hov many children were in the pool then? [Repeat. ] 

Turn to the next page. 
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0 Row 0. This number story is about shells. 17 shells are in a box. 
Some shells are little. 8 are big. How many little shells are in 
the box? [Repeat. ] 

P Row P. This number story is about soccer. For this story you may write 
on the paper if you want to. There were some soccer players on the field. 
23 more players came. Now there are 35 players on the field. How rany 
players were on the field at first? [Repeat. Use "puzzled face" and 
"make an X^' reminders as necessary. ] 

Q Look ac the problem in the arrow. What number is the answer 
what number is the answer? [Mention "puzzled face."} 

R Look at the problem in the arrow. \^at number is the answer . . • 
what number is the answer? [Mention "puzzled face. "] 

S Row S« We are going to count up from the number 12. When we count 

up one number from 12 we get 13. When we count up two numbers from 12 
ve get 14^. What do ve get when we count up five numbers from 12 ••• 
what do we get when we count up five numbers from 12? 

T Row T. Look at the garage and the cars. There are 15 cars altogether. 
Ve can see some cars outside the garage. The rest are inside the 
garage. How many cars are inside the garage? There are 15 cars 
altogether ... some are outside ... the rest are inside ... how 
many are inside? 

■ 

Turn to the next page. 

U Row U. I am going to tell you about some numbers listen ... 24 
comes 1 number after 23 ... 25 comes 2 numbers after 23 ... what 
number comes 6 numbers after 23 ... what number comes 6 numbers after 23? 



Now we will -do some different work. I will read a nxmber story to you. Then 
I want you to write a number sentence for the story. You don't need to solve 
the sentence. Just write the sentence the best you can without solving it. 
Write it on the line. 



A Judy has A chocolate cupcakes. She also has 7 white cupcakes « How many 
cupcakes does Judy have altogether? [Repeat. ] 

B Steve had 65 pennies. He gave 36 of them to Laura. How many pennies did 
Steve have left? [Repeat.] 

c There are 86 marbles in a jar. 54 are big and the rest are little. How 
many little marblea are in the jar? [Repeat.] 

D Adam has 7 puzzles. How many more puzzles does he have to put with 
then so he has 12 puzzles altogether? [Repeat.] 



Turn to the last page. 
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Tlhc work on this page is different. I want to see how quickly you can 
think of the answers for addition and subtraction problems. 

I am going to play a tape — the voice on the tape will say probleras, like 
this: [Play the four sarrple prcblcns 2 ^ 8, 5 -h 6^ 7 ^ 4, 8 3.] The 
problems will go very quickly, even faster than when you were in first grade. 
Today you probably will not know very nany answers, but when I come back and 
ve do these problems again, you will know more. Don't feel bad if you don't 
know the answers today. 

We will start with the row of bcxes at the top of the page— the ones with 
capital letters A, B, C .... The voice cn the tape will tell you where to 
vrite your answers. Do your best to keep up with the voice. Get your 
pencil ready. [Start tape.] 

Script on Tape : Look at the row of boxes at the top of the page. Find box 
A. I am going to say problems like 5 + ^- The answer for 5 + 4 is 9. 
So there is a 9 in box A. Find Box B. What is 7 + 1? 7 + 1 is 8. You 
vrlte an 8 in box B. 

[10 second pause; make sure the children are working on the top row. ] 
Nov I am going to say problems for all the rest of the boxes in the top 
row. I will not stop, so write your answers quickly. If you can't think of 
an answer, just leave the box empty. Ready? 

Form S Box C 3 -f 1 

Box D 2 + 5 

Box E 1+6 

Box F 7+2 

Box G 2+6 

Box H 3+5 

Box I 4 + 8 

Box J 3 + 7 

Box K 5+9 

Box L 6+8 

Box M 8+7 

Box N A + 9 
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Stop working. You may rest for a moment .then we will work on the bottom 
rov. 

[10 second pause] 

Ready to listen again? Look at the bottom row of boxes. Find Box A. This 
tijoe I am going to say problems like 9 6. The answer for 9 6 is 3. So 
there is a 3 in box A. Find box B. What is 4 - 2? 4 - 2 is 2. You write a 
2 in box B. 

^ [10 second pause — make sure the children are in the bottom row.} 

Nov I am going to say problems for the rest of the boxes. I will not stop, 
so write your answers quickly. If you can't think of an answer, leave the 
box empty. Ready? 

Form S Booc C 7-1 

Box D 8^4 

Box E 9-5 

Box F 7-4 

Box G 8-6 

Box H 4 - 3 

Box I 11 - 2 

Box J 13 ^ 8 

Box K 12 - 7 

Box L 15 - 9 

Box M 10 - 2 

Box N 16 ^ 7 
Stop working. Put your pencil down. 
{Stop the tape.] 

That is all the work we will do today, Remember, we will come again and you 
will do work like this again, Each tine I come, you will be able to do more 
of the work« 
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Directions for Administering Achievement Monitoring Test V 
Coordinated Study //I & //2 

General Directions 

Reading the Test . The first part of this test is in multiple choice format 
and is read aloud to the children. Read the questions exactly as they are 
printed in the directions; do not paraphrase. Each question is read twice — 
or the key phrases are repeated after the original question is read. Read 
the questions at a conversational pace. The second part of the test involves 
verbal problems for which the child must write, but not solve, a number sentence. 
Again, you will read the number story twice. The third part of the test is 
timed and assesses the child's speed and accuracy using the addition and sub- 
traction algorithms. The fourth segment, the basic facts speed test, is 
administered via tape. 

Since many children will not know how to do the majority of the test, 
especially at the beginning of the year, they will no doubt want to ask 
questions or want y u to repeat items yet again. Please do not allow 
this — instead, ask them to answer "as best they can" or to mark the 
"puzzled face" to show they have "not learned this yet." Note also that 
reading the answers to the children is not permitted. 

Since this is a group-administei-ed test, verbal exchanges with individual 

children can be distracting and interfering — try to establish a policy 

of not talking and not allowing the children to talk in between questions. 

Should the above directions seem unnecessarily stringent, please realize 
that we are attempting to measure change over time and that we have very 
few questions on which to base this moasurc-nent . The children will take 
the other forms of this same test at 6 week intervals and then they will 
repeat the three forms; hopefully each time they will be able to answer 
the questions more successfully. 

Make sure the children mark onl^y one box and that they mark at least one 
box. Encourage them to use the "puzzled face" by reminding them that this 
response means "I haven't learned this (how to do this) yet." 

P acing the Test . Try to keep the test moving. Expecially for the number 
story and algorithm problems it may take a "long" time for the children to 
figure out an answer. As a rule of thumb, allow the group to work on each 
question until only one or two children ar« still working. At that point, 
if necessary, suggest that anyone still working nark the "puzzled face" 
box. Then just go on to the next question without waiting longer, ihe 
se-ond part of the test, sentence writing, may go slowly. Remind the children 



108 




2 



75 V 



not to solve the problem. The thljTd part of the test is timed and must be 
administered accordinj ly. 

The last section, the raped basic facts, is a speed test. Once the tape is 
started, it will not be stopped. 

Estimated Administration Time s 

Part 1 10 min. 

Part 2 5 min. 

Part 3 15 min. 

Part 4 5 min. 



Preparations for Testing 

The childien will need two pencils with erasers. They will not need scratch 
paper for this test, since they will write in the "arrow" space. The children's 
names have been written on the tests in advance; distribute the tests, making 
sure each child has his/her own test. 

Specific Directions 

SAY: Today we are going to do some work with numbers in this booklet. You 

learned how to do some parts of the work last year in first grade. You 
will learn how to do more of the work this year in second grade. We don't 
expect you to know how to do all of the work today. We will come back 
again and again while you are in second grade . . . each tiiiie you will ' 
have learned how to do more of the work. 

Find your name on the line. Look at the big box with an X in it — 
you will answer the questions today by making a big X like this one. 

EXAMPLE A Now find row A. I am going to ask you a quesu-»on. You will answer 
by making a big X in one of the boxes. If you haven't learned about 
the answer yet, make an X in the last box, the one witn the puzzled 
* face. [Pause.] 

Which box has a trianfrlc in it? Make an X on the box with a triaii:,lc: 
^ in it. [Pause] If you haven't learned this yet, make an X on the box 

with the puzzled face. [Check to see that the children mark only one 
box in the row. ] 

EXA.lPLE B Find Row B. Look at the numbers in the arrow. What number comes next? 
Hake an X on the number that comes next. 
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Now turn to the next page and fold your booklet. 

[Note: Starting with row Cy do not assist the children with the testy 
except to make sure they are marking only one box . . . and at least 
one box. ] 

Row C. Look at the sticks in the arrow. Make an X on the box that 
tells how many sticks there are ... the box that tells how many sticks 
there axe. [Pause,] Remember, if you haven't learned about this yet, 
mark the puzzled face. 

Row D. Make an X on the box that has 24 cubes in it 24 cubes in it. 

Row E. I am golnj; to read a number story about toy airplanes. I 
will read the story twice. Listen both times before you mark a box. 
David has 9 toy airplanes. His sister Nancy has 13 toy airplanes. 
How many more toy airplanes does Nancy have than David? [Repeat. 
Allow time for the children to figure out their answers to rows E^H. ] 

Row F. This number story is about bottle caps. For this story you may 
write on the paper if you want to. Tom has 24 old bottle caps, ile also 
has 57 new bottle caps. How many bottle caps does Tom have altogether? 
[Repeat. If necessary y remind the children to ^'make an on their 
answer. Alsoy use the ^'puzzled face*' reminder as necessary,] 

Row G. This number story is about shells. 17 shells are in a box. 
Some shells are little. 8 are big. How many little shells are in 
the box? [Repeat. ] 

Row H. This number story is about soccer. For this story you may write 
on the paper if you Weint to. There were some soccer players on the field. 
23 more players came. Now there are 35 players on the field. How many 
players were on the field at first? [Eepeat. Use ''puzzled face*' and 
"make an X" reminders as necessary, ] 

Turn to the next page. 



Row I. Which box shows the numbers in order from smallest to largest . 
in order from smallest to largest? 

Row J. Look at the little squares in the arrow. Make an X on the box 
that tells how many squares there are... how many squares there are. 



Row K. Look at the number sentences. One of the number sentences 
tells how to find the answer for this story about hats. After I 
read the story, make an X on the number sentence that tells how to 
find the answer. Karla had 15 hats. She gave 9 hats to Steve. How 
many hats did Karla have left? [Repeat.] 
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L Row L. This number story Is about slickers. Makr» an X on the number 
sentence that tells how to find the answer. Sarah has 28 stickers. 
Her brother Ricky has 34 stickers. How many more stickers does Ricky 
have than Sarah? [Repeat. ] 

M Row M. This number story is about things to drink. There are 11 
glasses on the table. 5 have orange juice in them. The rest have 
milk in them. How many glasses have milk in them? [Repeat. ] 

N Row N. This number story is about children swiramlr^. There were 46 
children swimming in the pool. 27 more children jumped into the pool. 
How many children vpi-. in the pool then? [Repeat.] 

Turn to the next page. 

0 Row C. Look at the problem in the arrow. What number is the answer ... 
what number is the answer? [Mention "write on paper" reminder] 



P Row P. Look at the problem in the arrow. What number is the answer ... 
what number is the answer? 



Now we will do some different work. I will read a number story to you. Then 

I want you to write a number sentence for the story. You don't need to solve 

the sentence. Just write the sentence the best you can without solvirig it. 
Write it on the line. 



STORY A Judy has 4 chocolate cupcakes. She also has 7 white cupcakes. How many 

cupcakes does Judy have altogether? [Repeat* ] 

STORY B Steve had 65 pennies. He gave 36 of them to Laura. How many pennies did 

Steve have left? [Repeat.] 

STORY £ There are 86 marbles in a jar. 54 are big and the rest are little. How 

many little marbles are in the jar? [Repeat] 

STORY D Adam has 7 puzzles. How many niore puzzles does he have to put with 

them so he has 12 puzzles altogether? [Repeat.] 

[Give the children a short stand up- stretch- touch toes — and so on — ^^hreak'^ here] 
Turn to the next page, the one that says *'ADD'* at the top. 



Be sure you have the paf;c that says ^ADn ' on it All the problems on this 
page are addition problems. Each problem has a letter by it ... A, B, C, D... 
all the way to V» W and X. When I say "GO", start with problem A, then do B, 
then C, and so on until I say "STOP!" If you can't do a problem, go on to the 
next one. Do as many problems as you can before I say "STOP!" Ready? GO! 
(Allow 6 minutes) STOP! You worked very hard on these problems. You will be 
learning how to do them faster. (Reassure the children as you see fit.) Now 
turn to the page that says "SUBTRACT." 

Be sure you have the page that says "SUBTRACT." All the problems on this page 
are subtraction. When I say "GO," start with problem A, then do B, then C... 
do as many as you can before I say "STOP!" Ready? GO! (Allow 6 minutes.) 
I could tell you tried your best on these problems. You will be learning how 
to do them faster. 
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78 The work on this page Is diflcrent. I want to see how qu ickly you can 
think of the answers for addition and subtraction problems, 

I am going to play a tape — the voice on the tape will say problems, like 
this: [Play the four sample problems 2 i- 8, 5^6, 7 ^ 4y 5 -f 3, ] The 
problems will go very quickly, even faster than when you were in first grade. 
Today you probably will not know very many answers, but when I come back and 
we do these problems again, you will know mo: *. Don't feel bad if you don't 
know the answers today. 

We will start with the row of boxes at the top of the page — the ones with 
capital letters A, B, C The voice on the tape will tell you where to 

write your answers. Do your best to keep up with the voice. Get your 
pencil ready. [Start tape.] 

Script on Tape ; Look at the row of boxes at the top of the page. Find box 
A. 1 am going to say problems like 5+4, The answer for 5+4 is 9. 
So there is a 9 in box A. Find Box B. What is 7 + 1? 7 + 1 is 8. You 
write an 8 in box B. 

[10 second pause; make sure the children are working on the top roi).] 
Now I am going to say problems for all the rest of the boxes in the top 
row. I will not stop, so write your answers quickly. If you can't think of 
an answer, just leave the box empty. Ready? 

Form V Box C 3 + 1 

Box D 2 + 5 

Box E 1 + 5 

Box F 7 + 2 

Box G 2 + 6 

Box H 3 + 5 

Box I 4 + 8 

Box J 3 + 7 

Box K 5 + 9 

Box L 6 + 8 

Box M 8 + 7 

Box N 4+9 
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Stop working. You may rest for a moment .then we will work on the bottom 79 
row. 

[10 second pause] 

Ready to listen again? Look at the bottom row of boxes. Find Box A. This 
time I am going to say problems like 9-6. The answer for 9 - 6 is 3. So 
there is a 3 in box A. Find box B. What is 4 - 2? 4 - 2 is 2. You write a 
2 in box B. 

[10 second pause — make sure the children are in the bottom row,] 
Now I am going to say problems for the rest of the boxes. I will not stop, 
so write your answers quickly. If you can't think of an answer, leave the 
box empty. Ready? 

Form V Box C 7-1 

Box D 8-4 

Box E 9-5 

Box F 7-4 

Box G 8-6 

Box H 4-3 

ft 

Box I 11 - 2 

Box J 13 - 8 

Box K 12 - 7 

Box L 15 - 9 

Box M 10 - 2 

Box N 16 - 7 
Stop working. Put your pencil dovm. 
[Stop the tape.] 

That is all the work we will do today, Remember, we will come again and you 
will do work like this again. Each time I come, you will be able to do more 
of the work, 
{Collect the booklets,] 
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ID 

Name 




A 



ZI7 



10 II 12 



B 




13 
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Add 






y 


A. 53 
+ 3i 


G. 


7 

+•56 




•1- 45? 


s. 




B. 30 
■1-21 


H. 






231 
+ 653 


T 


351 • 
+ 2i>5 


C. 27 
+i2 


I. 


79 

+ 7 




1 15 
-t- 875 


U. 


HI 


D. 503 
+ 2<13 


J. 


+ _fe4: 


p 

I » 


174- 


V. 


11 

+ _58 


E- 2fc5 
+ 314- 


K. 


4-0 




+ ani 


w. 


(i>7 . 
ZS 
+ _22. . 


F. 33Z 


L. 
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A. 47 
- 42 



•a 5(o 

- 25 



C. 

- 7fc 



D. 498 
- H-S7 



E. 



4-82 
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Subtract 



G. 



32 

- s 



7*f 
- 8 



I. 



^1 
- 5 



- 22 



83 
(p7 



L. 



S5 
5S 



M. 2b"4 
- 138 



N. 3?8 
- 2&<? 



O. S!3 
- 408 



R 846 
- 393 



- 743 



R. 



72<i 

- 



119 



85 



- 334 



T 97Z 
- 586 



U 4-3 
- 337 



V. 730 
- H32 



W. 504- 
- 227 



X. 



600 



9 



A B C D E F G 



3 



Q 
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GUIDELINES FOR ACHIEVEMENT MONITORING 
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Guidelines 
Achievement Monitoring 



Test Assignment 

Grade 1 
Grade 2 
Grade 



Test K 
Test S 
Tes-l V 



ID Information 

Use the same ID's as for the Interviews: 

Example : 4 9 9 1 ^ 1 1^ 

scfool teacher ^ *^lld ^ Sandy^ay*^rade Child ID 

1 Teacher 



Bla^ 

The tests were checked for bias. There are US pennies pictured In 
both. If the administrators feel other terms are"Flased, have them 
changed but please keep a record of this and return It to me. The test 
administrators should realize that the February testing Is baseline and 
therefore should encourage the children to feel that they can mark the 
"puzrled face" if "they haven't learned about the question" yet. 
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Unda Harvey (01) 



Sandy Bay Infant School 



Testing and Observation Schedule (991,992) 



Interviews: 

Febniaiy 27-29 
J^ril 9-11 
May 26-28 



Achievement Monitoring: 

February 29 
April 11 
May 28 



Observations: 

' March 3 - May 23 

twice a week in each class during Maths period 



Teacher Logs: 

Filled out last observational day each week Jfarch 3 - May 23. 



ERIC 



90 



Wendy Craw (02) 



Walmea Heists Primary School 



Testing and Observation Schedule (993,995) 



Interviews : 

Februaiy 27-29 
April 9-11 
May 26-28 



Achievement Msnltorlng: 

February 29 
April 11 
May 28 



Observations : 
t 

March 3 - May 23 

twice a week in each class dxiring Maths period 



Teacher Logs 

Filled out last observational day each week March 3 - 23 
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Denlse Plsher (03) 

Walmea Hel^ite Primary School 

Testing and Observation Schedule (994) 

Interviews : 

Februaiy 27-29 
April 9-11 
May 26-28 

Achievement Manitoring: 

Februiiry 29 
Aprl3 11 
' May 28 

Observations : 

March 3 - May 23 
Three times a week during maths period 

Teacher Logs: 

Filled out last observational day each week March 3 - May 23 
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Appendix C 
COGNITIVE LEVEL BY ADMINISTRATION TABLES 
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Appendix C-1 

Frequency and Percent Correct for Composite Objectives by 
Cognitive Level and Administration Time for Grade 1, Form K 



4> 



Objectives 



Number 
of Items 



Prerequisite Instructional Objectives 
Numerousness 0-20 
Ordering 0-20 

Instructional Objectives for the S Topics 
Open Sentences 
Sentence-writing 0-20 

Nonlnstructlonal Objectives 
Problem-solving 0-20 
Counting 

Addition Facts Recall— Speeded Test 
Subtraction Facts Recall — Speeded Test 



Cognitive Level 1 

2 
2 

2 
4 

2 
3 
9 
9 



Feb, 


April 


May 








N=3 




N=3 




f/l 


t 


f/% 


t 


f/% 


t 


C /Q Q 


r 
0 




6 


5 /83 


6 


5/83 


6 


5/83 


6 


fi/i on 


LI 


3/50 


6 


1/17 


6 


3/50 


6 


3/25 


12 


0/0 


12 


1/8 


12 


3/50 


6 




6 


5/83 


6 


1/11 


9 




9 


I/IJ. 


9 


1/4 


27 


6/22 


27 


17/63 


27 


5/19 


27 


8/30 


27 


11/41 


27 
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Appendix C-1 (continued) 



Obiectives 


Number 
of I tems 


N=3 




April 
N=3 




May 
N=3 




f/% 


t 


f/% 


t 


f/% 


t 




Cognitive Level 2 














Prerequisite Instructional Objectives 
















Numerousness 0-20 


2 


6/100 


6 




/: 
0 


0/ lUU 


o 


Ordering 0-20 


2 


6/100 


6 


5/83 


6 




z: 
O 


Instructional Objectives for the S Topics 
















Open Sentences 


2 


1/17 


6 


3/50 


6 


3/50 


6 


Sentence-writing 0-20 


4 


3/25 


12 


3/25 


12 


3/25 


12 


Noninstructional Objectives 
















Problem-solving 0-20 


2 


5/83 


6 


3/50 


6 


5/83 


6 


Counting 


3 


3/33 


9 


7/78 


9 


6/67 


9 


Addition Facts Recall— Speeded Test 


9 


19/70 


27 


22/81 


27 


24/89 


27 


Subtraction Facts Recall — Speeded Test 


9 


12/44 


27 


18/67 


27 


19/70 


27 
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Appendix C-1 (continued) 



Objectives „ , 

Number 



Feb. April May 

N=l N=l N=l 



of Items f/% t f/% t f/% 



Cognitive Level 3 

Prerequisite Instructional Objectives 

Numerousness 0-20 2 1/50 2 1/50 2 2/100 2 

Ordering 0-20 2 2/100 2 2/100 2 2/100 2 

Instructional Objectives for the S Topics 

Open Sentences 2 0/2 0 1/50 2 1/50 2 

Sentence-writing 0-20 4 0/0 4 0/0 4 2/50 4 

Noninstructional Objectives 

ProblenHSolving 0-20 2 1/50 2 1/50 2 2/100 2 

Counting 3 0/0 3 0/0 3 2/67 3 

Addition Facts Recall— Speeded Test 9 1/11 9 3/33 9 7/78 9 

Subtraction Facts Recall — Speeded Test 9 l/ll 9 2/22 9 5/56 9 
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Appendix C-2 

Frequency and Percent Correct for Composite Objectives by 
Cognitive Level and Administration Time for Grade 2, Form S 



Objectives 


Number 
of Items 


1* eD 
N=2 




April 
N=2 


May 
N=2 






t/A 


t 


r / A 


t- 


z/% 


t 


Cognitive Level 1 














Prerequisite Instructional Objectives 
















Numerousness 0-99 


1^ 


1/50 


2 




9 


2/100 


2 


Ordering, Place Value 0-99 


2 


1/25 


4 


0/0 


4 


2/50 


4 


Instructional Objectives for the S and A Topics 
















Open Sentences 


2 


0/0 


4 


0/0 


4 


4/100 


4 


Sentence-writing 0-20, 0-99 (multiple choice) 


4 


0/0 


8 


0/0 


8 


1/13 


8 


Sentence-writing 0-20, 0-99 (free response) 


4 


0/0 


8 


4/50 


8 


5/63 


8 


Algorithms 


2 


0/0 


4 


0/0 


4 


1/25 


4 


Nonlnstructional Objectives 
















Problem-Solving 0-20, 0-99 


4 


4/50 


8 


4/50 


8 


3/38 


8 


Counting 


3 


2/33 


6 


1/17 


6 


3/50 


6 


Addition Facts Recall — Speeded Test 


12 


4/17 • 


24 


4/17 


24 


9/38 


24 


Subtraction Facts Recall — Speeded Test 


12 


2/8 


24 


2/8 


24 


12/50 


24 
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Appendix C-2 (continued) 



Feb. 



April 



May 



Objectives 


Number 
of Items 


N=5 




N=5 




N=4 






f /? 
1/ ^ 


L 




f- 
U 




L 


Cognitive Level 2 














Prerequisite Instructional Objectives 
















Numerousness 0-99 




2/40 


5 


4/80 


5 


2/50 


4 


Ordering, Place Value 0-99 


2 


0/0 


10 


0/0 


10 


0/0 


8 


Instructional Objectives for the S and A Topics 
















Open Sentences 


2 


2/20 


10 


5/50 


10 


6/75 


8 


Sentence-writing 0-20, 0-99 (multiple choice) 


4 


5/25 


20 


4/20 


20 


2/13 


16 


Sentence-writing 0-20, 0-99 (free response) 


4 


6/30 


20 


9/45 


20 


10/63 


16 


Algorithms 


2 


1/10 


10 


2/20 


10 


1/13 


8 



Noninstructional Objectives 
Problem-Solving 0-20, 0-99 
Countl»>s 

Addition Facts Recall — Speeded Test 
Subtraction Facts Recall — Speeded Test 



4 
3 
12 
12 



2/10 


20 


6/30 


20 


3/19 


16 


3/20 


15 


4/27 


15 


7/58 


12 


14/23 


60 


20/33 


60 


24/50 


48 


11/18 


60 


15/25 


60 


24/50 


48 
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Objectives 


Number 
of Items 


Feb 
N=2 

f/% 


t 


April 

N=2 

f/% t 


May 
N=2 

f/% 


t 


Cognitive Level 3 














Prerequisite Instructional Objectives 
















Numerousness 0-99 


1^ 


2/100 


2 


1/50 


2 


2/100 


2 


Ordering, Place Value 0-9^ 


2 


0/0 


4 


n/n 


A 
H 


1/25 


4 


Instructional Objectives for the S and A Topics 
















Open Sentences 


2 


1/25 


4 


2/50 


4 


4/100 


4 


Sentence-writing 0-20, 0-99 (multiple choice) 


4 


1/13 


8 


1/13 


8 


2/25 


8 


Sentence-writing 0-20, 0-99 (free response) 


4 


4/50 


8 


6/75 


8 


4/50 


8 


Algorithms 


2 


1/25 


4 


1/25 


4 


2/50 


4 


Norlnstructional Objectives 
















Problem- Solving 0-20, 0-99 


4 


2/25 


8 


4/50 


8 


2/25 


8 


Counting 


3 


3/50 


6 


4/67 


6 


5/83 


6 


Addition Facts Recall — Speeded Test 


12 


13/li4 


24 


14/58 


24 


16/67 


24 


Subtraction Facts Recall — Speeded Test 


12 


12/50 


24 


15/63 


24 


16/67 


24 



^o items were administered for the numerousness objective; students had difficulty reading one of the 
^ Items due to poor quality of th^ test duplication so data for this item were discarded. 
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Appendix C-3 

Frequency and Percent Correct for Composite Objectives by 
Cognitive Level and Administration Time for Grade 3, Forms S and V 



Objectives 



Number 
of Items 



Cognitive Level 2 



140 



Prerequisite Instructional Objectives 
Numerousness 0-99 
Ordering, Place Value 0-99 

Instructional Objectives for the S and A Topics 
Sentence-writing 0-20, 0-99 (multiple choice) 
Sentence-writing 0-20, 0-99 (free response) 

Nonlnstructlonal Objectives 
Problem-Solving 0-20, 0-99 
Addition Algorithms — Timed Test* 
Subtraction Algorithms—Timed Test* 
Addition Facts Recall — Speeded Test 
Subtraction Facts Recall — Speeded Test 



2 
2 

4 
4 

4 
24 
24 
12 
12 



Feb. 
N=4 



f/% 



4/50 
1/13 



7/44 
30/31 
12/13 
14/29 
13/27 



8 
8 



8/50 16 
4/25 16 



16 
96 
96 
48 
48 



April 
N=4 



f/% 



5/63 8 

4/50 8 

7/44 16 

11/69 16 

13/81 16 



25/52 48 
28/58 48 



May 

N=4 



f/% 



6/75 
3/38 

6/38 
11/69 

14/81 



8 
8 

16 
16 

16 



26/54 48 
20/42 48 



141 



ERIC 



» t 



continued 



Appendix C-3 (continued) 



Objectives 



Nxjmber 
of Items 



Cognitive Level 3 



Prerequisite Instructional Objectives 
Numerousness 0-99 
Ordering, Place Value 0-99 

Instructional Objectives for the S and A Topics 
Sentence-writing 0-20, 0-99 (multiple choica) 
Sentence-writing 0-20, 0-99 (free response) 

Noninstructional Objectives 
Problem-Solving 0-20, 0-99 
Addition Algorithms — Timed Test* 
Subtraction Algorithms — Timed Test* 
Addition Facts Recall — Speeded Test 
Subtraction Facts Recall — Speeded Test 



2 
2 

4 
4 

4 
24 
24 
12 
12 



Feb. 

N=7 



f/% 



9/64 
6/43 



14 
14 



10/36 28 

14/50 28 

20/71 28 

62/37 168 

25/15 168 

37/44 84 

31/37 84 



April 
N=6 



f/% 



9/75 12 

7/58 12 

16/67 24 

16/67 24 

16/67 24 



45/63 72 
47/65 72 



May 
N=7 



f/% 



11/79 
7/50 

16/57 
19/68 

22/79 
72/75 
53/55 
70/83 
57/68 



14 
14 

28 
28 

28 
96 
96 
84 
84 
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Appendix C-3 (continued) 



Feb. April May 

Objectives N=6 N=6 

Numbers — ^ 

of Items f/% t f/% 5 f/% 



Cognitive Level 4 

Prerequisite Instructional Objectives 

Numerousness 0-99 2 8/67 12 5/42 12 ll/92 12 

Ordering, Place Value 0-99 2 2/17 12 9/75 12 3/25 12 

Instructional Objectives for the S and A Topics 

Sentence-writing 0-20, 0-99 (multiple choice) 4 9/38 24 15/63 24 15/63 24 

Sentence-writing 0-20, 0-99 (free response) 4 6/25 24 14/58 24 17/71 24 

Non instructional Objectives 

Problem-Solving 0-20, 0-99 4 17/71 24 19/79 24 19/79 24 

Addition Algorithms — Timed Test^ 24 61/42 144 — 50/69 72 

Subtraction Algorithms— Timed Test^ 24 13/9 144 — 42/58 72 

Addition Facts Recall—Speeded Test 12 29/40 72 42/58 72 62/86 72 

Subtraction Facts Recall— Speeded Test 12 29/40 72 44/61 72 53/74 72 
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Appendix C-3 (continued) 



Objectives „ , 

Number 



Feb. April May 

N=5 N=6 N=6 



of Items f/% t f/% 



Cognitive Levels 5,6 

Prerequisite Instructional Objectives 

Numerousness 0-99 2 9/90 10 8/67 12 12/100 12 

Ordering, Place Value 0-99 2 4/40 10 11/92 12 8/67 12 

Instructional Objectives for the S and A Topics 

Sentence-writing 0-20, 0-99 (multiple choice) 4 9/45 20 15/63 24 20/83 24 

Sentence-writing 0-20, 0-99 (free response) 4 10/50 20 15/63 24 19/79 24 

Noninstructional Objectives 



ProblennSolving C-20, 0-99 4 15/75 20 21/88 24 22/92 24 

Addition Algorithms — Timed Test^ 24 60/50 120 — 112/93 120 

Subtraction Algorithms — Timed Test^ 24 29/24 120 — — 93/78 120 

Addition Facts Recall— Speeded Test 12 35/58 60 61/85 72 66/92 72 

Subtraction Facts Recall— Speeded Test 12 33/55 60 62/86 72 59/82 72 



2 


9/90 


10 


8/67 


12 


12/100 


2 


4/40 


10 


11/92 


12 


8/67 


4 


9/45 


20 


15/63 


24 


20/83 


4 


10/50 


20 


15/63 


24 


19/79 


4 


15/75 


20 


21/88 


24 


22/92 


24 


60/50 


120 






112/93 


24 


29/24 


120 






93/78 


12 


35/58 


60 


61/85 


72 


66/92 


12 


33/55 


60 


62/86 


72 


59/82 



^his objective was assessed in February for 22 students representing all cognitive levels (N=12, 20, 
18, 17) and in May for 12 students at all levels except 2 (N=0, 4, 3, 5). It was not assessed in April. 
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